2023-08-23T00:45:45.695 INFO:root:teuthology version: 0.0.1.dev185+g449a1bc 2023-08-23T00:45:45.696 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/yuriw-2023-08-22_18:59:01-rbd-pacific-release-distro-default-smithi/7376986 --verbose --name yuriw-2023-08-22_18:59:01-rbd-pacific-release-distro-default-smithi --description rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} --owner scheduled_yuriw@teuthology -- /home/teuthworker/archive/yuriw-2023-08-22_18:59:01-rbd-pacific-release-distro-default-smithi/7376986/orig.config.yaml 2023-08-23T00:45:45.736 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T00:45:45.822 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-08-22_18:59:01-rbd-pacific-release-distro-default-smithi/7376986 branch: pacific-release description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} email: null first_in_suite: false job_id: '7376986' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2023-08-22_18:59:01-rbd-pacific-release-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: pacific-release ceph: conf: client: rbd default format: 1 global: mon client directed command retry: 5 ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(CACHE_POOL_NEAR_FULL\) - \(CACHE_POOL_NO_HIT_SET\) sha1: 21b2d401852937440c3da8ce2b19224181760caa ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log global: osd crush chooseleaf type: 0 osd pool default pg num: 128 osd pool default pgp num: 128 osd pool default size: 2 mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 21b2d401852937440c3da8ce2b19224181760caa thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: pacific-release sha1: 21b2d401852937440c3da8ce2b19224181760caa owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - osd.0 - osd.1 - osd.2 - client.0 seed: 8823 sha1: 21b2d401852937440c3da8ce2b19224181760caa sleep_before_teardown: 0 subset: 111/120000 suite: rbd suite_branch: pacific-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 21b2d401852937440c3da8ce2b19224181760caa targets: smithi012.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0= tasks: - install: null - ceph: null - exec: client.0: - sudo ceph osd pool create cache 4 - sudo ceph osd tier add rbd cache - sudo ceph osd tier cache-mode cache writeback - sudo ceph osd tier set-overlay rbd cache - sudo ceph osd pool set cache hit_set_type bloom - sudo ceph osd pool set cache hit_set_count 8 - sudo ceph osd pool set cache hit_set_period 60 - sudo ceph osd pool set cache target_max_objects 250 - workunit: clients: client.0: - rbd/cli_generic.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 449a1bc2027504e7b3c3d7b30fa4178906581da7 timestamp: 2023-08-22_18:59:01 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2224 2023-08-23T00:45:45.823 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa; will attempt to use it 2023-08-23T00:45:45.824 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa/tasks 2023-08-23T00:45:45.825 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-23T00:45:45.827 INFO:teuthology.task.internal:Checking packages... 2023-08-23T00:45:45.868 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '21b2d401852937440c3da8ce2b19224181760caa' 2023-08-23T00:45:45.869 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-23T00:45:45.869 INFO:teuthology.packaging:ref: None 2023-08-23T00:45:45.869 INFO:teuthology.packaging:tag: None 2023-08-23T00:45:45.869 INFO:teuthology.packaging:branch: pacific-release 2023-08-23T00:45:45.870 INFO:teuthology.packaging:sha1: 21b2d401852937440c3da8ce2b19224181760caa 2023-08-23T00:45:45.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=pacific-release 2023-08-23T00:45:46.102 INFO:teuthology.task.internal:Found packages for ceph version 16.2.13-560-g21b2d401-1focal 2023-08-23T00:45:46.103 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-23T00:45:46.117 INFO:teuthology.task.internal:no buildpackages task found 2023-08-23T00:45:46.117 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-23T00:45:46.142 INFO:teuthology.task.internal:Saving configuration 2023-08-23T00:45:46.156 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-23T00:45:46.162 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T00:45:46.187 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-22_18:59:01-rbd-pacific-release-distro-default-smithi/7376986', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 00:40:02.001119', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-08-23T00:45:46.187 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-23T00:45:46.193 INFO:teuthology.task.internal:roles: ubuntu@smithi012.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0'] 2023-08-23T00:45:46.194 INFO:teuthology.run_tasks:Running task console_log... 2023-08-23T00:45:46.241 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fed4bf07e50>, signals=[15]) 2023-08-23T00:45:46.242 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-23T00:45:46.251 INFO:teuthology.task.internal:Opening connections... 2023-08-23T00:45:46.252 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi012.front.sepia.ceph.com 2023-08-23T00:45:46.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:45:46.320 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-23T00:45:46.331 DEBUG:teuthology.orchestra.run.smithi012:> uname -m 2023-08-23T00:45:46.447 INFO:teuthology.orchestra.run.smithi012.stdout:x86_64 2023-08-23T00:45:46.447 DEBUG:teuthology.orchestra.run.smithi012:> cat /etc/os-release 2023-08-23T00:45:46.454 INFO:teuthology.orchestra.run.smithi012.stdout:NAME="Ubuntu" 2023-08-23T00:45:46.454 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-08-23T00:45:46.455 INFO:teuthology.orchestra.run.smithi012.stdout:ID=ubuntu 2023-08-23T00:45:46.455 INFO:teuthology.orchestra.run.smithi012.stdout:ID_LIKE=debian 2023-08-23T00:45:46.455 INFO:teuthology.orchestra.run.smithi012.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-08-23T00:45:46.455 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_ID="20.04" 2023-08-23T00:45:46.456 INFO:teuthology.orchestra.run.smithi012.stdout:HOME_URL="https://www.ubuntu.com/" 2023-08-23T00:45:46.456 INFO:teuthology.orchestra.run.smithi012.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-08-23T00:45:46.456 INFO:teuthology.orchestra.run.smithi012.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-08-23T00:45:46.456 INFO:teuthology.orchestra.run.smithi012.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-08-23T00:45:46.456 INFO:teuthology.orchestra.run.smithi012.stdout:VERSION_CODENAME=focal 2023-08-23T00:45:46.457 INFO:teuthology.orchestra.run.smithi012.stdout:UBUNTU_CODENAME=focal 2023-08-23T00:45:46.459 INFO:teuthology.lock.ops:Updating smithi012.front.sepia.ceph.com on lock server 2023-08-23T00:45:46.525 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-23T00:45:46.536 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-23T00:45:46.544 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-23T00:45:46.544 DEBUG:teuthology.orchestra.run.smithi012:> test '!' -e /home/ubuntu/cephtest 2023-08-23T00:45:46.554 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-23T00:45:46.567 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-23T00:45:46.568 DEBUG:teuthology.orchestra.run.smithi012:> test -z $(ls -A /var/lib/ceph) 2023-08-23T00:45:46.582 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-23T00:45:46.618 INFO:teuthology.run_tasks:Running task kernel... 2023-08-23T00:45:46.632 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-08-23T00:45:46.633 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-08-23T00:45:46.634 DEBUG:teuthology.orchestra.run.smithi012:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-23T00:45:46.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-23T00:45:46.641 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2023-08-23T00:45:46.691 INFO:teuthology.orchestra.run.smithi012.stdout:5.4.0-124-generic 2023-08-23T00:45:46.691 INFO:teuthology.task.kernel:Running kernel on smithi012: 5.4.0-124-generic 2023-08-23T00:45:46.692 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get clean 2023-08-23T00:45:46.797 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2023-08-23T00:45:46.942 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-08-23T00:45:46.946 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-08-23T00:45:46.946 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-08-23T00:45:47.016 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-08-23T00:45:47.336 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [632 kB] 2023-08-23T00:45:47.416 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,365 kB] 2023-08-23T00:45:47.456 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [373 kB] 2023-08-23T00:45:47.458 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.0 kB] 2023-08-23T00:45:47.458 INFO:teuthology.orchestra.run.smithi012.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [32.3 kB] 2023-08-23T00:45:47.459 INFO:teuthology.orchestra.run.smithi012.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,070 kB] 2023-08-23T00:45:47.474 INFO:teuthology.orchestra.run.smithi012.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [864 kB] 2023-08-23T00:45:47.474 INFO:teuthology.orchestra.run.smithi012.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [289 kB] 2023-08-23T00:45:47.476 INFO:teuthology.orchestra.run.smithi012.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [580 B] 2023-08-23T00:45:47.476 INFO:teuthology.orchestra.run.smithi012.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [869 kB] 2023-08-23T00:45:47.483 INFO:teuthology.orchestra.run.smithi012.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [611 kB] 2023-08-23T00:45:47.523 INFO:teuthology.orchestra.run.smithi012.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [182 kB] 2023-08-23T00:45:47.543 INFO:teuthology.orchestra.run.smithi012.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,767 kB] 2023-08-23T00:45:47.581 INFO:teuthology.orchestra.run.smithi012.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [456 kB] 2023-08-23T00:45:47.584 INFO:teuthology.orchestra.run.smithi012.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.0 kB] 2023-08-23T00:45:47.584 INFO:teuthology.orchestra.run.smithi012.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,185 kB] 2023-08-23T00:45:47.598 INFO:teuthology.orchestra.run.smithi012.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [33.7 kB] 2023-08-23T00:45:47.598 INFO:teuthology.orchestra.run.smithi012.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [306 kB] 2023-08-23T00:45:47.601 INFO:teuthology.orchestra.run.smithi012.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [576 B] 2023-08-23T00:45:47.602 INFO:teuthology.orchestra.run.smithi012.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [744 kB] 2023-08-23T00:45:47.606 INFO:teuthology.orchestra.run.smithi012.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,101 kB] 2023-08-23T00:45:47.612 INFO:teuthology.orchestra.run.smithi012.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.0 kB] 2023-08-23T00:45:47.612 INFO:teuthology.orchestra.run.smithi012.stdout:Get:27 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-08-23T00:45:47.613 INFO:teuthology.orchestra.run.smithi012.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-08-23T00:45:47.614 INFO:teuthology.orchestra.run.smithi012.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [263 kB] 2023-08-23T00:45:47.614 INFO:teuthology.orchestra.run.smithi012.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-08-23T00:45:47.615 INFO:teuthology.orchestra.run.smithi012.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.4 kB] 2023-08-23T00:45:47.615 INFO:teuthology.orchestra.run.smithi012.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-08-23T00:45:47.616 INFO:teuthology.orchestra.run.smithi012.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.8 kB] 2023-08-23T00:45:47.617 INFO:teuthology.orchestra.run.smithi012.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-08-23T00:45:47.617 INFO:teuthology.orchestra.run.smithi012.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-08-23T00:45:47.636 INFO:teuthology.orchestra.run.smithi012.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-08-23T00:45:47.636 INFO:teuthology.orchestra.run.smithi012.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-08-23T00:45:47.636 INFO:teuthology.orchestra.run.smithi012.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-08-23T00:45:47.636 INFO:teuthology.orchestra.run.smithi012.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-08-23T00:45:47.636 INFO:teuthology.orchestra.run.smithi012.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-08-23T00:45:47.637 INFO:teuthology.orchestra.run.smithi012.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-08-23T00:45:47.637 INFO:teuthology.orchestra.run.smithi012.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-08-23T00:45:51.467 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 16.8 MB in 3s (6,681 kB/s) 2023-08-23T00:45:53.025 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2023-08-23T00:45:53.053 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-08-23T00:45:53.143 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2023-08-23T00:45:53.347 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2023-08-23T00:45:53.348 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2023-08-23T00:45:53.535 INFO:teuthology.orchestra.run.smithi012.stdout:The following additional packages will be installed: 2023-08-23T00:45:53.535 INFO:teuthology.orchestra.run.smithi012.stdout: linux-generic linux-headers-5.4.0-156 linux-headers-5.4.0-156-generic 2023-08-23T00:45:53.535 INFO:teuthology.orchestra.run.smithi012.stdout: linux-headers-generic linux-image-5.4.0-156-generic 2023-08-23T00:45:53.535 INFO:teuthology.orchestra.run.smithi012.stdout: linux-modules-5.4.0-156-generic linux-modules-extra-5.4.0-156-generic 2023-08-23T00:45:53.536 INFO:teuthology.orchestra.run.smithi012.stdout:Suggested packages: 2023-08-23T00:45:53.536 INFO:teuthology.orchestra.run.smithi012.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-08-23T00:45:53.536 INFO:teuthology.orchestra.run.smithi012.stdout:Recommended packages: 2023-08-23T00:45:53.536 INFO:teuthology.orchestra.run.smithi012.stdout: thermald 2023-08-23T00:45:53.594 INFO:teuthology.orchestra.run.smithi012.stdout:The following NEW packages will be installed: 2023-08-23T00:45:53.594 INFO:teuthology.orchestra.run.smithi012.stdout: linux-headers-5.4.0-156 linux-headers-5.4.0-156-generic 2023-08-23T00:45:53.594 INFO:teuthology.orchestra.run.smithi012.stdout: linux-image-5.4.0-156-generic linux-modules-5.4.0-156-generic 2023-08-23T00:45:53.595 INFO:teuthology.orchestra.run.smithi012.stdout: linux-modules-extra-5.4.0-156-generic 2023-08-23T00:45:53.595 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages will be upgraded: 2023-08-23T00:45:53.596 INFO:teuthology.orchestra.run.smithi012.stdout: linux-generic linux-headers-generic linux-image-generic 2023-08-23T00:45:53.776 INFO:teuthology.orchestra.run.smithi012.stdout:3 upgraded, 5 newly installed, 0 to remove and 249 not upgraded. 2023-08-23T00:45:53.777 INFO:teuthology.orchestra.run.smithi012.stdout:Need to get 77.1 MB of archives. 2023-08-23T00:45:53.777 INFO:teuthology.orchestra.run.smithi012.stdout:After this operation, 380 MB of additional disk space will be used. 2023-08-23T00:45:53.777 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-156-generic amd64 5.4.0-156.173 [15.0 MB] 2023-08-23T00:45:54.901 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-156-generic amd64 5.4.0-156.173 [10.5 MB] 2023-08-23T00:45:55.169 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-156-generic amd64 5.4.0-156.173 [39.2 MB] 2023-08-23T00:45:56.467 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.156.152 [1,900 B] 2023-08-23T00:45:56.468 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.156.152 [2,592 B] 2023-08-23T00:45:56.468 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-156 all 5.4.0-156.173 [11.0 MB] 2023-08-23T00:45:56.757 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-156-generic amd64 5.4.0-156.173 [1,349 kB] 2023-08-23T00:45:56.785 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.156.152 [2,468 B] 2023-08-23T00:45:57.512 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 77.1 MB in 3s (24.2 MB/s) 2023-08-23T00:45:57.696 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-modules-5.4.0-156-generic. 2023-08-23T00:45:59.439 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-08-23T00:45:59.446 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../0-linux-modules-5.4.0-156-generic_5.4.0-156.173_amd64.deb ... 2023-08-23T00:45:59.568 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-modules-5.4.0-156-generic (5.4.0-156.173) ... 2023-08-23T00:46:01.520 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-image-5.4.0-156-generic. 2023-08-23T00:46:01.536 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../1-linux-image-5.4.0-156-generic_5.4.0-156.173_amd64.deb ... 2023-08-23T00:46:01.631 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-image-5.4.0-156-generic (5.4.0-156.173) ... 2023-08-23T00:46:03.044 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-156-generic. 2023-08-23T00:46:03.060 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-156-generic_5.4.0-156.173_amd64.deb ... 2023-08-23T00:46:03.106 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-modules-extra-5.4.0-156-generic (5.4.0-156.173) ... 2023-08-23T00:46:07.948 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../3-linux-generic_5.4.0.156.152_amd64.deb ... 2023-08-23T00:46:08.095 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-generic (5.4.0.156.152) over (5.4.0.124.125) ... 2023-08-23T00:46:08.449 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.156.152_amd64.deb ... 2023-08-23T00:46:08.575 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-image-generic (5.4.0.156.152) over (5.4.0.124.125) ... 2023-08-23T00:46:08.919 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-headers-5.4.0-156. 2023-08-23T00:46:08.934 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../5-linux-headers-5.4.0-156_5.4.0-156.173_all.deb ... 2023-08-23T00:46:08.979 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-5.4.0-156 (5.4.0-156.173) ... 2023-08-23T00:46:14.532 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package linux-headers-5.4.0-156-generic. 2023-08-23T00:46:14.553 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../6-linux-headers-5.4.0-156-generic_5.4.0-156.173_amd64.deb ... 2023-08-23T00:46:14.590 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-5.4.0-156-generic (5.4.0-156.173) ... 2023-08-23T00:46:17.394 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.156.152_amd64.deb ... 2023-08-23T00:46:17.545 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking linux-headers-generic (5.4.0.156.152) over (5.4.0.124.125) ... 2023-08-23T00:46:17.885 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-modules-5.4.0-156-generic (5.4.0-156.173) ... 2023-08-23T00:46:19.194 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-5.4.0-156 (5.4.0-156.173) ... 2023-08-23T00:46:19.320 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-image-5.4.0-156-generic (5.4.0-156.173) ... 2023-08-23T00:46:20.508 INFO:teuthology.orchestra.run.smithi012.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-156-generic 2023-08-23T00:46:20.508 INFO:teuthology.orchestra.run.smithi012.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-156-generic 2023-08-23T00:46:20.682 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-5.4.0-156-generic (5.4.0-156.173) ... 2023-08-23T00:46:20.789 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-modules-extra-5.4.0-156-generic (5.4.0-156.173) ... 2023-08-23T00:46:21.992 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-headers-generic (5.4.0.156.152) ... 2023-08-23T00:46:22.117 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-image-generic (5.4.0.156.152) ... 2023-08-23T00:46:22.268 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up linux-generic (5.4.0.156.152) ... 2023-08-23T00:46:22.394 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for linux-image-5.4.0-156-generic (5.4.0-156.173) ... 2023-08-23T00:46:22.461 INFO:teuthology.orchestra.run.smithi012.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-08-23T00:46:22.461 INFO:teuthology.orchestra.run.smithi012.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-156-generic 2023-08-23T00:46:45.218 INFO:teuthology.orchestra.run.smithi012.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-08-23T00:46:45.218 INFO:teuthology.orchestra.run.smithi012.stdout:Sourcing file `/etc/default/grub' 2023-08-23T00:46:45.225 INFO:teuthology.orchestra.run.smithi012.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-08-23T00:46:45.238 INFO:teuthology.orchestra.run.smithi012.stdout:Generating grub configuration file ... 2023-08-23T00:46:45.574 INFO:teuthology.orchestra.run.smithi012.stdout:Found linux image: /boot/vmlinuz-5.4.0-156-generic 2023-08-23T00:46:45.603 INFO:teuthology.orchestra.run.smithi012.stdout:Found initrd image: /boot/initrd.img-5.4.0-156-generic 2023-08-23T00:46:46.021 INFO:teuthology.orchestra.run.smithi012.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-08-23T00:46:46.033 INFO:teuthology.orchestra.run.smithi012.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-08-23T00:46:48.829 INFO:teuthology.orchestra.run.smithi012.stdout:done 2023-08-23T00:46:49.281 DEBUG:teuthology.orchestra.run.smithi012:> dpkg -s linux-image-generic 2023-08-23T00:46:49.338 INFO:teuthology.orchestra.run.smithi012.stdout:Package: linux-image-generic 2023-08-23T00:46:49.339 INFO:teuthology.orchestra.run.smithi012.stdout:Status: install ok installed 2023-08-23T00:46:49.339 INFO:teuthology.orchestra.run.smithi012.stdout:Priority: optional 2023-08-23T00:46:49.339 INFO:teuthology.orchestra.run.smithi012.stdout:Section: kernel 2023-08-23T00:46:49.339 INFO:teuthology.orchestra.run.smithi012.stdout:Installed-Size: 19 2023-08-23T00:46:49.339 INFO:teuthology.orchestra.run.smithi012.stdout:Maintainer: Ubuntu Kernel Team 2023-08-23T00:46:49.340 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: amd64 2023-08-23T00:46:49.340 INFO:teuthology.orchestra.run.smithi012.stdout:Source: linux-meta 2023-08-23T00:46:49.340 INFO:teuthology.orchestra.run.smithi012.stdout:Version: 5.4.0.156.152 2023-08-23T00:46:49.340 INFO:teuthology.orchestra.run.smithi012.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-08-23T00:46:49.340 INFO:teuthology.orchestra.run.smithi012.stdout:Depends: linux-image-5.4.0-156-generic, linux-modules-extra-5.4.0-156-generic, linux-firmware, intel-microcode, amd64-microcode 2023-08-23T00:46:49.340 INFO:teuthology.orchestra.run.smithi012.stdout:Recommends: thermald 2023-08-23T00:46:49.341 INFO:teuthology.orchestra.run.smithi012.stdout:Description: Generic Linux kernel image 2023-08-23T00:46:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: This package will always depend on the latest generic kernel image 2023-08-23T00:46:49.341 INFO:teuthology.orchestra.run.smithi012.stdout: available. 2023-08-23T00:46:49.341 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-156-generic 2023-08-23T00:46:49.341 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-08-23T00:46:49.342 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-08-23T00:46:49.342 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-08-23T00:46:49.342 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi012.front.sepia.ceph.com, path=None, version=distro) 2023-08-23T00:46:49.343 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get clean 2023-08-23T00:46:49.455 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2023-08-23T00:46:49.594 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-08-23T00:46:49.595 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-08-23T00:46:49.600 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-08-23T00:46:49.617 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-08-23T00:46:51.376 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2023-08-23T00:46:51.401 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-08-23T00:46:51.476 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2023-08-23T00:46:51.679 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2023-08-23T00:46:51.680 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2023-08-23T00:46:51.896 INFO:teuthology.orchestra.run.smithi012.stdout:linux-image-generic is already the newest version (5.4.0.156.152). 2023-08-23T00:46:51.896 INFO:teuthology.orchestra.run.smithi012.stdout:0 upgraded, 0 newly installed, 0 to remove and 249 not upgraded. 2023-08-23T00:46:51.898 DEBUG:teuthology.orchestra.run.smithi012:> dpkg -s linux-image-generic 2023-08-23T00:46:51.920 INFO:teuthology.orchestra.run.smithi012.stdout:Package: linux-image-generic 2023-08-23T00:46:51.921 INFO:teuthology.orchestra.run.smithi012.stdout:Status: install ok installed 2023-08-23T00:46:51.921 INFO:teuthology.orchestra.run.smithi012.stdout:Priority: optional 2023-08-23T00:46:51.921 INFO:teuthology.orchestra.run.smithi012.stdout:Section: kernel 2023-08-23T00:46:51.921 INFO:teuthology.orchestra.run.smithi012.stdout:Installed-Size: 19 2023-08-23T00:46:51.921 INFO:teuthology.orchestra.run.smithi012.stdout:Maintainer: Ubuntu Kernel Team 2023-08-23T00:46:51.922 INFO:teuthology.orchestra.run.smithi012.stdout:Architecture: amd64 2023-08-23T00:46:51.922 INFO:teuthology.orchestra.run.smithi012.stdout:Source: linux-meta 2023-08-23T00:46:51.922 INFO:teuthology.orchestra.run.smithi012.stdout:Version: 5.4.0.156.152 2023-08-23T00:46:51.922 INFO:teuthology.orchestra.run.smithi012.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-08-23T00:46:51.922 INFO:teuthology.orchestra.run.smithi012.stdout:Depends: linux-image-5.4.0-156-generic, linux-modules-extra-5.4.0-156-generic, linux-firmware, intel-microcode, amd64-microcode 2023-08-23T00:46:51.922 INFO:teuthology.orchestra.run.smithi012.stdout:Recommends: thermald 2023-08-23T00:46:51.922 INFO:teuthology.orchestra.run.smithi012.stdout:Description: Generic Linux kernel image 2023-08-23T00:46:51.922 INFO:teuthology.orchestra.run.smithi012.stdout: This package will always depend on the latest generic kernel image 2023-08-23T00:46:51.923 INFO:teuthology.orchestra.run.smithi012.stdout: available. 2023-08-23T00:46:51.923 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2023-08-23T00:46:51.968 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.ZtisTg7MEj 2023-08-23T00:46:51.969 DEBUG:teuthology.orchestra.run.smithi012:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ZtisTg7MEj 2023-08-23T00:46:51.986 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.ZtisTg7MEj 2023-08-23T00:46:52.073 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.ZtisTg7MEj is 9KB 2023-08-23T00:46:52.130 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.ZtisTg7MEj 2023-08-23T00:46:52.137 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-08-23T00:46:52.152 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:46:52.152 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-08-23T00:46:52.152 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-08-23T00:46:52.231 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-156-generic 2023-08-23T00:46:52.231 DEBUG:teuthology.orchestra.run.smithi012:> sudo update-grub 2023-08-23T00:46:53.660 INFO:teuthology.orchestra.run.smithi012.stderr:Sourcing file `/etc/default/grub' 2023-08-23T00:46:53.678 INFO:teuthology.orchestra.run.smithi012.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-08-23T00:46:53.688 INFO:teuthology.orchestra.run.smithi012.stderr:Generating grub configuration file ... 2023-08-23T00:46:53.939 INFO:teuthology.orchestra.run.smithi012.stderr:Found linux image: /boot/vmlinuz-5.4.0-156-generic 2023-08-23T00:46:53.951 INFO:teuthology.orchestra.run.smithi012.stderr:Found initrd image: /boot/initrd.img-5.4.0-156-generic 2023-08-23T00:46:54.337 INFO:teuthology.orchestra.run.smithi012.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-08-23T00:46:54.348 INFO:teuthology.orchestra.run.smithi012.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-08-23T00:46:55.994 INFO:teuthology.orchestra.run.smithi012.stderr:done 2023-08-23T00:46:55.996 DEBUG:teuthology.orchestra.run.smithi012:> sudo shutdown -r now 2023-08-23T00:47:26.028 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-08-23T00:47:26.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-08-23T00:47:26.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:47:44.496 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.12 2023-08-23T00:47:53.504 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-08-23T00:47:53.505 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:48:53.564 DEBUG:teuthology.orchestra.remote:timed out 2023-08-23T00:49:05.576 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-08-23T00:49:05.577 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:49:05.798 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-08-23T00:49:06.407 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-08-23T00:49:06.407 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-156-generic"... 2023-08-23T00:49:06.408 DEBUG:teuthology.orchestra.run.smithi012:> uname -r 2023-08-23T00:49:06.414 INFO:teuthology.orchestra.run.smithi012.stdout:5.4.0-156-generic 2023-08-23T00:49:06.415 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-156-generic vs 5.4.0-156-generic 2023-08-23T00:49:06.415 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-08-23T00:49:06.415 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-08-23T00:49:07.416 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-08-23T00:49:07.417 DEBUG:teuthology.orchestra.run.smithi012:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-23T00:49:07.523 INFO:teuthology.orchestra.run.smithi012.stdout:ttyS1 2023-08-23T00:49:07.561 DEBUG:teuthology.parallel:result is None 2023-08-23T00:49:07.562 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-23T00:49:07.568 INFO:teuthology.task.internal:Creating test directory... 2023-08-23T00:49:07.569 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-23T00:49:07.576 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-23T00:49:07.593 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-23T00:49:07.600 INFO:teuthology.task.internal:Creating archive directory... 2023-08-23T00:49:07.600 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-23T00:49:07.637 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-23T00:49:07.645 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-23T00:49:07.646 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-23T00:49:07.694 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-23T00:49:07.709 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-23T00:49:07.710 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-23T00:49:07.722 INFO:teuthology.task.internal:Configuring sudo... 2023-08-23T00:49:07.722 DEBUG:teuthology.orchestra.run.smithi012:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-23T00:49:07.739 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-23T00:49:07.749 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-23T00:49:07.749 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-23T00:49:07.791 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-23T00:49:07.798 DEBUG:teuthology.orchestra.run.smithi012:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-23T00:49:07.805 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:49:07.805 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-23T00:49:07.873 DEBUG:teuthology.orchestra.run.smithi012:> sudo service rsyslog restart 2023-08-23T00:49:07.922 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-23T00:49:07.936 INFO:teuthology.task.internal:Starting timer... 2023-08-23T00:49:07.936 INFO:teuthology.run_tasks:Running task pcp... 2023-08-23T00:49:07.948 INFO:teuthology.run_tasks:Running task selinux... 2023-08-23T00:49:08.011 DEBUG:teuthology.task.selinux:Excluding smithi012: OS 'ubuntu' does not support SELinux 2023-08-23T00:49:08.012 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-23T00:49:08.012 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-08-23T00:49:08.012 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-23T00:49:08.012 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-23T00:49:08.021 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-08-23T00:49:08.022 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-23T00:49:08.045 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-23T00:49:08.047 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi012.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-23T00:55:08.925 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi012.front.sepia.ceph.com')] 2023-08-23T00:55:08.927 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-08-23T00:55:08.928 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi012.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-23T00:55:08.983 DEBUG:teuthology.orchestra.run.smithi012:> true 2023-08-23T00:55:09.109 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi012.front.sepia.ceph.com' 2023-08-23T00:55:09.110 INFO:teuthology.run_tasks:Running task clock... 2023-08-23T00:55:09.122 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-23T00:55:09.123 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-23T00:55:09.124 DEBUG:teuthology.orchestra.run.smithi012:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-23T00:55:09.185 INFO:teuthology.orchestra.run.smithi012.stdout:23 Aug 00:55:09 ntpd[22485]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-08-23T00:55:09.185 INFO:teuthology.orchestra.run.smithi012.stdout:23 Aug 00:55:09 ntpd[22485]: Command line: ntpd -gq 2023-08-23T00:55:09.186 INFO:teuthology.orchestra.run.smithi012.stdout:23 Aug 00:55:09 ntpd[22485]: proto: precision = 0.078 usec (-24) 2023-08-23T00:55:09.186 INFO:teuthology.orchestra.run.smithi012.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-08-23T00:55:09.187 INFO:teuthology.orchestra.run.smithi012.stdout:23 Aug 00:55:09 ntpd[22485]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-08-23T00:55:09.187 INFO:teuthology.orchestra.run.smithi012.stderr:restrict ::: KOD does nothing without LIMITED. 2023-08-23T00:55:09.188 INFO:teuthology.orchestra.run.smithi012.stdout:23 Aug 00:55:09 ntpd[22485]: restrict ::: KOD does nothing without LIMITED. 2023-08-23T00:55:09.188 INFO:teuthology.orchestra.run.smithi012.stdout:23 Aug 00:55:09 ntpd[22485]: Listen and drop on 0 v6wildcard [::]:123 2023-08-23T00:55:09.188 INFO:teuthology.orchestra.run.smithi012.stdout:23 Aug 00:55:09 ntpd[22485]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-08-23T00:55:09.189 INFO:teuthology.orchestra.run.smithi012.stdout:23 Aug 00:55:09 ntpd[22485]: Listen normally on 2 lo 127.0.0.1:123 2023-08-23T00:55:09.189 INFO:teuthology.orchestra.run.smithi012.stdout:23 Aug 00:55:09 ntpd[22485]: Listen normally on 3 ens1f0 172.21.15.12:123 2023-08-23T00:55:09.189 INFO:teuthology.orchestra.run.smithi012.stdout:23 Aug 00:55:09 ntpd[22485]: Listen normally on 4 lo [::1]:123 2023-08-23T00:55:09.189 INFO:teuthology.orchestra.run.smithi012.stdout:23 Aug 00:55:09 ntpd[22485]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:25ea%4]:123 2023-08-23T00:55:09.189 INFO:teuthology.orchestra.run.smithi012.stdout:23 Aug 00:55:09 ntpd[22485]: Listening on routing socket on fd #22 for interface updates 2023-08-23T00:55:10.186 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:10 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:10.186 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:10 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:10.186 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:10 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:10.186 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:10 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:10.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:10 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:10.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:10 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:10.188 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:10 ntpd[22485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-23T00:55:10.188 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:10 ntpd[22485]: can't open /var/log/ntpstats/peerstats.20230823: Permission denied 2023-08-23T00:55:10.188 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:10 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:10.188 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:10 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:10.188 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:10 ntpd[22485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-23T00:55:10.188 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:10 ntpd[22485]: can't open /var/log/ntpstats/peerstats.20230823: Permission denied 2023-08-23T00:55:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:12 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:12.186 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:12 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:12 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:12 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:12 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:12 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:12 ntpd[22485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-23T00:55:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:12 ntpd[22485]: can't open /var/log/ntpstats/peerstats.20230823: Permission denied 2023-08-23T00:55:12.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:12 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:12 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:12 ntpd[22485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-23T00:55:12.188 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:12 ntpd[22485]: can't open /var/log/ntpstats/peerstats.20230823: Permission denied 2023-08-23T00:55:13.186 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:13 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:13.186 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:13 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:14.188 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:14.189 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:14.189 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:14.189 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:14.189 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:14.189 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:14.189 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:14.189 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:14.190 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-23T00:55:14.190 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: can't open /var/log/ntpstats/peerstats.20230823: Permission denied 2023-08-23T00:55:14.190 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:14.190 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:14.190 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-23T00:55:14.190 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: can't open /var/log/ntpstats/peerstats.20230823: Permission denied 2023-08-23T00:55:14.190 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:14.191 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:14.191 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-23T00:55:14.191 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:14 ntpd[22485]: can't open /var/log/ntpstats/peerstats.20230823: Permission denied 2023-08-23T00:55:16.186 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:16 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:16.186 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:16 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:16.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:16 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:16.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:16 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:16.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:16 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:16.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:16 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:16.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:16 ntpd[22485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-08-23T00:55:16.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:16 ntpd[22485]: can't open /var/log/ntpstats/rawstats.20230823: Permission denied 2023-08-23T00:55:16.187 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:16 ntpd[22485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-08-23T00:55:16.188 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:16 ntpd[22485]: can't open /var/log/ntpstats/peerstats.20230823: Permission denied 2023-08-23T00:55:16.188 INFO:teuthology.orchestra.run.smithi012.stdout:23 Aug 00:55:16 ntpd[22485]: ntpd: time slew +0.002269 s 2023-08-23T00:55:16.189 INFO:teuthology.orchestra.run.smithi012.stdout:ntpd: time slew +0.002269s 2023-08-23T00:55:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:16 ntpd[22485]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-08-23T00:55:16.189 INFO:teuthology.orchestra.run.smithi012.stderr:23 Aug 00:55:16 ntpd[22485]: can't open /var/log/ntpstats/loopstats.20230823: Permission denied 2023-08-23T00:55:16.249 INFO:teuthology.orchestra.run.smithi012.stdout: remote refid st t when poll reach delay offset jitter 2023-08-23T00:55:16.249 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================== 2023-08-23T00:55:16.249 INFO:teuthology.orchestra.run.smithi012.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-08-23T00:55:16.250 INFO:teuthology.orchestra.run.smithi012.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-08-23T00:55:16.250 INFO:teuthology.orchestra.run.smithi012.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-08-23T00:55:16.250 INFO:teuthology.orchestra.run.smithi012.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-08-23T00:55:16.251 INFO:teuthology.run_tasks:Running task install... 2023-08-23T00:55:16.260 DEBUG:teuthology.task.install:project ceph 2023-08-23T00:55:16.260 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '21b2d401852937440c3da8ce2b19224181760caa'}} 2023-08-23T00:55:16.261 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '21b2d401852937440c3da8ce2b19224181760caa'} 2023-08-23T00:55:16.261 INFO:teuthology.task.install:Using flavor: default 2023-08-23T00:55:16.310 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-23T00:55:16.311 INFO:teuthology.task.install:extra packages: [] 2023-08-23T00:55:16.312 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-key list | grep Ceph 2023-08-23T00:55:16.423 INFO:teuthology.orchestra.run.smithi012.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-08-23T00:55:16.485 INFO:teuthology.orchestra.run.smithi012.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-08-23T00:55:16.485 INFO:teuthology.orchestra.run.smithi012.stdout:uid [ unknown] Ceph.com (release key) 2023-08-23T00:55:16.486 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-08-23T00:55:16.487 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=21b2d401852937440c3da8ce2b19224181760caa 2023-08-23T00:55:16.756 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default/ 2023-08-23T00:55:16.757 INFO:teuthology.task.install.deb:Package version is 16.2.13-560-g21b2d401-1focal 2023-08-23T00:55:16.903 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:55:16.904 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-08-23T00:55:16.921 DEBUG:teuthology.orchestra.run.smithi012:> sudo apt-get update 2023-08-23T00:55:17.116 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-08-23T00:55:17.119 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-08-23T00:55:17.136 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-08-23T00:55:17.208 INFO:teuthology.orchestra.run.smithi012.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal InRelease 2023-08-23T00:55:17.239 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal Release [7,680 B] 2023-08-23T00:55:17.250 INFO:teuthology.orchestra.run.smithi012.stdout:Hit:6 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-08-23T00:55:17.270 INFO:teuthology.orchestra.run.smithi012.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal Release.gpg 2023-08-23T00:55:17.300 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main i386 Packages [3,103 B] 2023-08-23T00:55:17.348 INFO:teuthology.orchestra.run.smithi012.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 Packages [17.2 kB] 2023-08-23T00:55:17.782 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 28.0 kB in 1s (43.4 kB/s) 2023-08-23T00:55:18.836 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2023-08-23T00:55:18.862 DEBUG:teuthology.orchestra.run.smithi012:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=16.2.13-560-g21b2d401-1focal cephadm=16.2.13-560-g21b2d401-1focal ceph-mds=16.2.13-560-g21b2d401-1focal ceph-mgr=16.2.13-560-g21b2d401-1focal ceph-common=16.2.13-560-g21b2d401-1focal ceph-fuse=16.2.13-560-g21b2d401-1focal ceph-test=16.2.13-560-g21b2d401-1focal radosgw=16.2.13-560-g21b2d401-1focal python3-rados=16.2.13-560-g21b2d401-1focal python3-rgw=16.2.13-560-g21b2d401-1focal python3-cephfs=16.2.13-560-g21b2d401-1focal python3-rbd=16.2.13-560-g21b2d401-1focal libcephfs2=16.2.13-560-g21b2d401-1focal libcephfs-dev=16.2.13-560-g21b2d401-1focal librados2=16.2.13-560-g21b2d401-1focal librbd1=16.2.13-560-g21b2d401-1focal rbd-fuse=16.2.13-560-g21b2d401-1focal 2023-08-23T00:55:18.929 INFO:teuthology.orchestra.run.smithi012.stdout:Reading package lists... 2023-08-23T00:55:19.131 INFO:teuthology.orchestra.run.smithi012.stdout:Building dependency tree... 2023-08-23T00:55:19.131 INFO:teuthology.orchestra.run.smithi012.stdout:Reading state information... 2023-08-23T00:55:19.314 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages were automatically installed and are no longer required: 2023-08-23T00:55:19.315 INFO:teuthology.orchestra.run.smithi012.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-08-23T00:55:19.315 INFO:teuthology.orchestra.run.smithi012.stdout:Use 'sudo apt autoremove' to remove them. 2023-08-23T00:55:19.315 INFO:teuthology.orchestra.run.smithi012.stdout:The following additional packages will be installed: 2023-08-23T00:55:19.315 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-08-23T00:55:19.317 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq libjaeger 2023-08-23T00:55:19.317 INFO:teuthology.orchestra.run.smithi012.stdout: libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2023-08-23T00:55:19.317 INFO:teuthology.orchestra.run.smithi012.stdout: liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 libradosstriper1 2023-08-23T00:55:19.317 INFO:teuthology.orchestra.run.smithi012.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli python-pastedeploy-tpl 2023-08-23T00:55:19.317 INFO:teuthology.orchestra.run.smithi012.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2023-08-23T00:55:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2023-08-23T00:55:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2023-08-23T00:55:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-08-23T00:55:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-08-23T00:55:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2023-08-23T00:55:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-08-23T00:55:19.318 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-08-23T00:55:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2023-08-23T00:55:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2023-08-23T00:55:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-08-23T00:55:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-08-23T00:55:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2023-08-23T00:55:19.319 INFO:teuthology.orchestra.run.smithi012.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2023-08-23T00:55:19.320 INFO:teuthology.orchestra.run.smithi012.stdout:Suggested packages: 2023-08-23T00:55:19.320 INFO:teuthology.orchestra.run.smithi012.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2023-08-23T00:55:19.320 INFO:teuthology.orchestra.run.smithi012.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-08-23T00:55:19.320 INFO:teuthology.orchestra.run.smithi012.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-08-23T00:55:19.320 INFO:teuthology.orchestra.run.smithi012.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-08-23T00:55:19.321 INFO:teuthology.orchestra.run.smithi012.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-08-23T00:55:19.321 INFO:teuthology.orchestra.run.smithi012.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-08-23T00:55:19.321 INFO:teuthology.orchestra.run.smithi012.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-08-23T00:55:19.321 INFO:teuthology.orchestra.run.smithi012.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-08-23T00:55:19.321 INFO:teuthology.orchestra.run.smithi012.stdout:Recommended packages: 2023-08-23T00:55:19.321 INFO:teuthology.orchestra.run.smithi012.stdout: btrfs-tools 2023-08-23T00:55:19.434 INFO:teuthology.orchestra.run.smithi012.stdout:The following NEW packages will be installed: 2023-08-23T00:55:19.434 INFO:teuthology.orchestra.run.smithi012.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-08-23T00:55:19.434 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-08-23T00:55:19.435 INFO:teuthology.orchestra.run.smithi012.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev 2023-08-23T00:55:19.435 INFO:teuthology.orchestra.run.smithi012.stdout: libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2023-08-23T00:55:19.435 INFO:teuthology.orchestra.run.smithi012.stdout: libleveldb1d liblttng-ust0 liblua5.3-0 liboath0 libonig5 librabbitmq4 2023-08-23T00:55:19.437 INFO:teuthology.orchestra.run.smithi012.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph nvme-cli 2023-08-23T00:55:19.437 INFO:teuthology.orchestra.run.smithi012.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2023-08-23T00:55:19.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-08-23T00:55:19.437 INFO:teuthology.orchestra.run.smithi012.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2023-08-23T00:55:19.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-08-23T00:55:19.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-08-23T00:55:19.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-mako python3-markupsafe python3-oauthlib python3-openssl 2023-08-23T00:55:19.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-08-23T00:55:19.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-08-23T00:55:19.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2023-08-23T00:55:19.438 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2023-08-23T00:55:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2023-08-23T00:55:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-08-23T00:55:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2023-08-23T00:55:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2023-08-23T00:55:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2023-08-23T00:55:19.439 INFO:teuthology.orchestra.run.smithi012.stdout:The following packages will be upgraded: 2023-08-23T00:55:19.439 INFO:teuthology.orchestra.run.smithi012.stdout: librados2 librbd1 2023-08-23T00:55:19.628 INFO:teuthology.orchestra.run.smithi012.stdout:2 upgraded, 98 newly installed, 0 to remove and 231 not upgraded. 2023-08-23T00:55:19.628 INFO:teuthology.orchestra.run.smithi012.stdout:Need to get 173 MB of archives. 2023-08-23T00:55:19.629 INFO:teuthology.orchestra.run.smithi012.stdout:After this operation, 804 MB of additional disk space will be used. 2023-08-23T00:55:19.629 INFO:teuthology.orchestra.run.smithi012.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-08-23T00:55:19.689 INFO:teuthology.orchestra.run.smithi012.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 16.2.13-560-g21b2d401-1focal [3,944 B] 2023-08-23T00:55:19.779 INFO:teuthology.orchestra.run.smithi012.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 16.2.13-560-g21b2d401-1focal [3,383 kB] 2023-08-23T00:55:20.024 INFO:teuthology.orchestra.run.smithi012.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-08-23T00:55:20.032 INFO:teuthology.orchestra.run.smithi012.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-08-23T00:55:20.077 INFO:teuthology.orchestra.run.smithi012.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-08-23T00:55:20.090 INFO:teuthology.orchestra.run.smithi012.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-08-23T00:55:20.217 INFO:teuthology.orchestra.run.smithi012.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2023-08-23T00:55:20.239 INFO:teuthology.orchestra.run.smithi012.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-08-23T00:55:20.248 INFO:teuthology.orchestra.run.smithi012.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-08-23T00:55:20.276 INFO:teuthology.orchestra.run.smithi012.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-08-23T00:55:20.282 INFO:teuthology.orchestra.run.smithi012.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-08-23T00:55:20.285 INFO:teuthology.orchestra.run.smithi012.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-08-23T00:55:20.464 INFO:teuthology.orchestra.run.smithi012.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-08-23T00:55:20.630 INFO:teuthology.orchestra.run.smithi012.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-08-23T00:55:20.660 INFO:teuthology.orchestra.run.smithi012.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-08-23T00:55:20.684 INFO:teuthology.orchestra.run.smithi012.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-08-23T00:55:20.801 INFO:teuthology.orchestra.run.smithi012.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-08-23T00:55:20.813 INFO:teuthology.orchestra.run.smithi012.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-08-23T00:55:20.817 INFO:teuthology.orchestra.run.smithi012.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-08-23T00:55:20.885 INFO:teuthology.orchestra.run.smithi012.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-08-23T00:55:20.901 INFO:teuthology.orchestra.run.smithi012.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-08-23T00:55:20.935 INFO:teuthology.orchestra.run.smithi012.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-08-23T00:55:20.962 INFO:teuthology.orchestra.run.smithi012.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-08-23T00:55:21.130 INFO:teuthology.orchestra.run.smithi012.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-08-23T00:55:21.197 INFO:teuthology.orchestra.run.smithi012.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 16.2.13-560-g21b2d401-1focal [3,393 kB] 2023-08-23T00:55:21.659 INFO:teuthology.orchestra.run.smithi012.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-08-23T00:55:21.659 INFO:teuthology.orchestra.run.smithi012.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-08-23T00:55:21.662 INFO:teuthology.orchestra.run.smithi012.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-08-23T00:55:21.666 INFO:teuthology.orchestra.run.smithi012.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 16.2.13-560-g21b2d401-1focal [728 kB] 2023-08-23T00:55:21.666 INFO:teuthology.orchestra.run.smithi012.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-08-23T00:55:21.677 INFO:teuthology.orchestra.run.smithi012.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-08-23T00:55:21.701 INFO:teuthology.orchestra.run.smithi012.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-08-23T00:55:21.714 INFO:teuthology.orchestra.run.smithi012.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-08-23T00:55:21.715 INFO:teuthology.orchestra.run.smithi012.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-08-23T00:55:21.749 INFO:teuthology.orchestra.run.smithi012.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-08-23T00:55:21.752 INFO:teuthology.orchestra.run.smithi012.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 16.2.13-560-g21b2d401-1focal [413 kB] 2023-08-23T00:55:21.762 INFO:teuthology.orchestra.run.smithi012.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-08-23T00:55:21.795 INFO:teuthology.orchestra.run.smithi012.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 16.2.13-560-g21b2d401-1focal [22.2 kB] 2023-08-23T00:55:21.796 INFO:teuthology.orchestra.run.smithi012.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 16.2.13-560-g21b2d401-1focal [212 kB] 2023-08-23T00:55:21.822 INFO:teuthology.orchestra.run.smithi012.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 16.2.13-560-g21b2d401-1focal [38.4 kB] 2023-08-23T00:55:21.834 INFO:teuthology.orchestra.run.smithi012.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 16.2.13-560-g21b2d401-1focal [387 kB] 2023-08-23T00:55:21.872 INFO:teuthology.orchestra.run.smithi012.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 16.2.13-560-g21b2d401-1focal [3,688 kB] 2023-08-23T00:55:21.936 INFO:teuthology.orchestra.run.smithi012.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-08-23T00:55:22.020 INFO:teuthology.orchestra.run.smithi012.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-08-23T00:55:22.104 INFO:teuthology.orchestra.run.smithi012.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-08-23T00:55:22.209 INFO:teuthology.orchestra.run.smithi012.stdout:Get:47 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 16.2.13-560-g21b2d401-1focal [116 kB] 2023-08-23T00:55:22.211 INFO:teuthology.orchestra.run.smithi012.stdout:Get:48 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 16.2.13-560-g21b2d401-1focal [448 kB] 2023-08-23T00:55:22.233 INFO:teuthology.orchestra.run.smithi012.stdout:Get:49 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 16.2.13-560-g21b2d401-1focal [22.6 MB] 2023-08-23T00:55:22.911 INFO:teuthology.orchestra.run.smithi012.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-08-23T00:55:22.934 INFO:teuthology.orchestra.run.smithi012.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-08-23T00:55:22.936 INFO:teuthology.orchestra.run.smithi012.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-08-23T00:55:23.016 INFO:teuthology.orchestra.run.smithi012.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-08-23T00:55:23.017 INFO:teuthology.orchestra.run.smithi012.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-08-23T00:55:23.018 INFO:teuthology.orchestra.run.smithi012.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-08-23T00:55:23.018 INFO:teuthology.orchestra.run.smithi012.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-08-23T00:55:23.019 INFO:teuthology.orchestra.run.smithi012.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-08-23T00:55:23.183 INFO:teuthology.orchestra.run.smithi012.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-08-23T00:55:23.267 INFO:teuthology.orchestra.run.smithi012.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-08-23T00:55:23.444 INFO:teuthology.orchestra.run.smithi012.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-08-23T00:55:23.460 INFO:teuthology.orchestra.run.smithi012.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-08-23T00:55:23.492 INFO:teuthology.orchestra.run.smithi012.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-08-23T00:55:23.622 INFO:teuthology.orchestra.run.smithi012.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-08-23T00:55:23.658 INFO:teuthology.orchestra.run.smithi012.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-08-23T00:55:23.681 INFO:teuthology.orchestra.run.smithi012.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-08-23T00:55:23.689 INFO:teuthology.orchestra.run.smithi012.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-08-23T00:55:23.732 INFO:teuthology.orchestra.run.smithi012.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-08-23T00:55:23.758 INFO:teuthology.orchestra.run.smithi012.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-08-23T00:55:23.945 INFO:teuthology.orchestra.run.smithi012.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-08-23T00:55:24.029 INFO:teuthology.orchestra.run.smithi012.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-08-23T00:55:24.130 INFO:teuthology.orchestra.run.smithi012.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-08-23T00:55:24.153 INFO:teuthology.orchestra.run.smithi012.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-08-23T00:55:24.268 INFO:teuthology.orchestra.run.smithi012.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-08-23T00:55:24.553 INFO:teuthology.orchestra.run.smithi012.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-08-23T00:55:24.555 INFO:teuthology.orchestra.run.smithi012.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-08-23T00:55:24.559 INFO:teuthology.orchestra.run.smithi012.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-08-23T00:55:24.560 INFO:teuthology.orchestra.run.smithi012.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-08-23T00:55:24.570 INFO:teuthology.orchestra.run.smithi012.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-08-23T00:55:24.574 INFO:teuthology.orchestra.run.smithi012.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-08-23T00:55:24.740 INFO:teuthology.orchestra.run.smithi012.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-08-23T00:55:24.907 INFO:teuthology.orchestra.run.smithi012.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-08-23T00:55:25.159 INFO:teuthology.orchestra.run.smithi012.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-08-23T00:55:33.078 INFO:teuthology.orchestra.run.smithi012.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 16.2.13-560-g21b2d401-1focal [5,916 kB] 2023-08-23T00:55:33.705 INFO:teuthology.orchestra.run.smithi012.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 16.2.13-560-g21b2d401-1focal [204 kB] 2023-08-23T00:55:33.738 INFO:teuthology.orchestra.run.smithi012.stdout:Get:85 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 16.2.13-560-g21b2d401-1focal [126 kB] 2023-08-23T00:55:33.745 INFO:teuthology.orchestra.run.smithi012.stdout:Get:86 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 16.2.13-560-g21b2d401-1focal [1,533 kB] 2023-08-23T00:55:33.919 INFO:teuthology.orchestra.run.smithi012.stdout:Get:87 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 16.2.13-560-g21b2d401-1focal [6,997 kB] 2023-08-23T00:55:38.730 INFO:teuthology.orchestra.run.smithi012.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 16.2.13-560-g21b2d401-1focal [26.2 MB] 2023-08-23T00:55:45.995 INFO:teuthology.orchestra.run.smithi012.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 16.2.13-560-g21b2d401-1focal [4,040 B] 2023-08-23T00:55:45.996 INFO:teuthology.orchestra.run.smithi012.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 16.2.13-560-g21b2d401-1focal [834 kB] 2023-08-23T00:55:46.151 INFO:teuthology.orchestra.run.smithi012.stdout:Get:91 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 16.2.13-560-g21b2d401-1focal [2,363 kB] 2023-08-23T00:55:46.787 INFO:teuthology.orchestra.run.smithi012.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 16.2.13-560-g21b2d401-1focal [76.4 kB] 2023-08-23T00:55:46.821 INFO:teuthology.orchestra.run.smithi012.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 16.2.13-560-g21b2d401-1focal [100 kB] 2023-08-23T00:55:46.828 INFO:teuthology.orchestra.run.smithi012.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 16.2.13-560-g21b2d401-1focal [2,823 kB] 2023-08-23T00:55:47.357 INFO:teuthology.orchestra.run.smithi012.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 16.2.13-560-g21b2d401-1focal [7,862 kB] 2023-08-23T00:55:48.614 INFO:teuthology.orchestra.run.smithi012.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 16.2.13-560-g21b2d401-1focal [4,156 B] 2023-08-23T00:55:48.617 INFO:teuthology.orchestra.run.smithi012.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 16.2.13-560-g21b2d401-1focal [49.3 MB] 2023-08-23T00:55:54.301 INFO:teuthology.orchestra.run.smithi012.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 16.2.13-560-g21b2d401-1focal [21.5 kB] 2023-08-23T00:55:54.302 INFO:teuthology.orchestra.run.smithi012.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 16.2.13-560-g21b2d401-1focal [11.3 MB] 2023-08-23T00:55:55.159 INFO:teuthology.orchestra.run.smithi012.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/pacific-release/21b2d401852937440c3da8ce2b19224181760caa/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 16.2.13-560-g21b2d401-1focal [78.4 kB] 2023-08-23T00:55:55.786 INFO:teuthology.orchestra.run.smithi012.stdout:Fetched 173 MB in 36s (4,857 kB/s) 2023-08-23T00:55:55.885 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libjaeger. 2023-08-23T00:55:55.940 INFO:teuthology.orchestra.run.smithi012.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141760 files and directories currently installed.) 2023-08-23T00:55:55.944 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../00-libjaeger_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:55:55.974 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libjaeger (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:55:56.329 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-08-23T00:55:56.346 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../01-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-08-23T00:55:56.429 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-08-23T00:55:56.801 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../02-librbd1_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:55:56.950 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librbd1 (16.2.13-560-g21b2d401-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-08-23T00:55:57.649 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../03-librados2_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:55:57.771 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librados2 (16.2.13-560-g21b2d401-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-08-23T00:55:58.467 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libcephfs2. 2023-08-23T00:55:58.486 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../04-libcephfs2_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:55:58.525 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libcephfs2 (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:55:58.872 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rados. 2023-08-23T00:55:58.887 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../05-python3-rados_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:55:58.928 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rados (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:55:59.315 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-08-23T00:55:59.330 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../06-python3-ceph-argparse_16.2.13-560-g21b2d401-1focal_all.deb ... 2023-08-23T00:55:59.397 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-ceph-argparse (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:55:59.750 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cephfs. 2023-08-23T00:55:59.768 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../07-python3-cephfs_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:55:59.808 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cephfs (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:00.145 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-ceph-common. 2023-08-23T00:56:00.162 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../08-python3-ceph-common_16.2.13-560-g21b2d401-1focal_all.deb ... 2023-08-23T00:56:00.203 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-ceph-common (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:00.548 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-prettytable. 2023-08-23T00:56:00.565 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../09-python3-prettytable_0.7.2-5_all.deb ... 2023-08-23T00:56:00.606 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-08-23T00:56:00.883 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rbd. 2023-08-23T00:56:00.901 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../10-python3-rbd_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:00.942 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rbd (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:01.420 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-08-23T00:56:01.440 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../11-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-08-23T00:56:01.511 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-08-23T00:56:01.889 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-08-23T00:56:01.907 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../12-librabbitmq4_0.10.0-1_amd64.deb ... 2023-08-23T00:56:01.947 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-08-23T00:56:02.302 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-08-23T00:56:02.318 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../13-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-08-23T00:56:02.351 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-08-23T00:56:02.730 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package librgw2. 2023-08-23T00:56:02.746 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../14-librgw2_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:02.796 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking librgw2 (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:03.417 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rgw. 2023-08-23T00:56:03.434 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../15-python3-rgw_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:03.475 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rgw (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:03.817 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libleveldb1d:amd64. 2023-08-23T00:56:03.834 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../16-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2023-08-23T00:56:03.875 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-08-23T00:56:04.245 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liboath0. 2023-08-23T00:56:04.262 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../17-liboath0_2.6.1-1.3_amd64.deb ... 2023-08-23T00:56:04.336 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-08-23T00:56:04.673 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libradosstriper1. 2023-08-23T00:56:04.692 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../18-libradosstriper1_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:04.723 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libradosstriper1 (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:05.210 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-common. 2023-08-23T00:56:05.228 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../19-ceph-common_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:05.268 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-common (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:07.457 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-base. 2023-08-23T00:56:07.474 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../20-ceph-base_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:07.542 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-base (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:08.504 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cryptography. 2023-08-23T00:56:08.524 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../21-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-08-23T00:56:08.562 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-08-23T00:56:09.024 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-openssl. 2023-08-23T00:56:09.042 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../22-python3-openssl_19.0.0-1build1_all.deb ... 2023-08-23T00:56:09.082 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-08-23T00:56:09.352 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-08-23T00:56:09.372 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../23-ceph-mgr-modules-core_16.2.13-560-g21b2d401-1focal_all.deb ... 2023-08-23T00:56:09.402 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-modules-core (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:09.798 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-bcrypt. 2023-08-23T00:56:09.815 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../24-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-08-23T00:56:09.857 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-08-23T00:56:10.168 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cherrypy3. 2023-08-23T00:56:10.188 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../25-python3-cherrypy3_8.9.1-6_all.deb ... 2023-08-23T00:56:10.220 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-08-23T00:56:10.591 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jwt. 2023-08-23T00:56:10.611 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../26-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-08-23T00:56:10.649 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-08-23T00:56:11.019 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-logutils. 2023-08-23T00:56:11.035 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../27-python3-logutils_0.3.3-7_all.deb ... 2023-08-23T00:56:11.102 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-08-23T00:56:11.388 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-markupsafe. 2023-08-23T00:56:11.405 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../28-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-08-23T00:56:11.471 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-08-23T00:56:11.799 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-mako. 2023-08-23T00:56:11.819 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../29-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-08-23T00:56:11.866 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-08-23T00:56:12.219 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-simplegeneric. 2023-08-23T00:56:12.235 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../30-python3-simplegeneric_0.8.1-3_all.deb ... 2023-08-23T00:56:12.277 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-08-23T00:56:12.613 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-singledispatch. 2023-08-23T00:56:12.630 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../31-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-08-23T00:56:12.671 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-08-23T00:56:13.007 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-webob. 2023-08-23T00:56:13.024 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../32-python3-webob_1%3a1.8.5-2_all.deb ... 2023-08-23T00:56:13.066 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-08-23T00:56:13.419 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-soupsieve. 2023-08-23T00:56:13.437 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../33-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-08-23T00:56:13.477 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-08-23T00:56:13.830 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-bs4. 2023-08-23T00:56:13.847 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../34-python3-bs4_4.8.2-1_all.deb ... 2023-08-23T00:56:13.922 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-08-23T00:56:14.393 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-waitress. 2023-08-23T00:56:14.413 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../35-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-08-23T00:56:14.561 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-08-23T00:56:14.911 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-tempita. 2023-08-23T00:56:14.929 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../36-python3-tempita_0.5.2-6_all.deb ... 2023-08-23T00:56:14.994 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-08-23T00:56:15.322 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-paste. 2023-08-23T00:56:15.341 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../37-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-08-23T00:56:15.380 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-08-23T00:56:15.725 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-08-23T00:56:15.742 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../38-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-08-23T00:56:15.783 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-08-23T00:56:16.111 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pastedeploy. 2023-08-23T00:56:16.127 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../39-python3-pastedeploy_2.1.0-1_all.deb ... 2023-08-23T00:56:16.169 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-08-23T00:56:16.497 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-webtest. 2023-08-23T00:56:16.514 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../40-python3-webtest_2.0.32-2_all.deb ... 2023-08-23T00:56:16.560 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-08-23T00:56:16.891 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pecan. 2023-08-23T00:56:16.908 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../41-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-08-23T00:56:16.950 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-08-23T00:56:17.338 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-werkzeug. 2023-08-23T00:56:17.365 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../42-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-08-23T00:56:17.396 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-08-23T00:56:17.782 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-08-23T00:56:17.801 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../43-libsqlite3-mod-ceph_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:17.840 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libsqlite3-mod-ceph (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:18.235 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr. 2023-08-23T00:56:18.254 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../44-ceph-mgr_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:18.293 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:18.813 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mon. 2023-08-23T00:56:18.833 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../45-ceph-mon_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:18.905 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mon (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:20.008 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-osd. 2023-08-23T00:56:20.026 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../46-ceph-osd_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:20.066 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-osd (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:22.696 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph. 2023-08-23T00:56:22.716 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../47-ceph_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:22.754 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:23.116 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-fuse. 2023-08-23T00:56:23.133 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../48-ceph-fuse_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:23.189 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-fuse (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:23.610 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mds. 2023-08-23T00:56:23.629 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../49-ceph-mds_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:23.668 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mds (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:24.264 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package cephadm. 2023-08-23T00:56:24.283 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../50-cephadm_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:24.321 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking cephadm (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:24.649 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-jinja2. 2023-08-23T00:56:24.668 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../51-python3-jinja2_2.10.1-2_all.deb ... 2023-08-23T00:56:24.707 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-08-23T00:56:25.060 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-08-23T00:56:25.078 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../52-ceph-mgr-cephadm_16.2.13-560-g21b2d401-1focal_all.deb ... 2023-08-23T00:56:25.118 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-cephadm (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:25.472 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-repoze.lru. 2023-08-23T00:56:25.488 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../53-python3-repoze.lru_0.7-2_all.deb ... 2023-08-23T00:56:25.530 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-08-23T00:56:25.792 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libjs-underscore. 2023-08-23T00:56:25.809 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../54-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-08-23T00:56:25.849 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-08-23T00:56:26.134 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-08-23T00:56:26.153 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../55-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-08-23T00:56:26.193 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-08-23T00:56:26.562 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-routes. 2023-08-23T00:56:26.579 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../56-python3-routes_2.4.1-2_all.deb ... 2023-08-23T00:56:26.620 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-08-23T00:56:26.998 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-08-23T00:56:27.015 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../57-ceph-mgr-dashboard_16.2.13-560-g21b2d401-1focal_all.deb ... 2023-08-23T00:56:27.056 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-dashboard (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:28.105 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-decorator. 2023-08-23T00:56:28.123 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../58-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-08-23T00:56:28.188 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-08-23T00:56:28.524 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-08-23T00:56:28.544 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../59-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-08-23T00:56:28.582 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-08-23T00:56:28.935 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-scipy. 2023-08-23T00:56:28.952 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../60-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-08-23T00:56:28.993 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-08-23T00:56:30.369 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-08-23T00:56:30.387 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../61-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-08-23T00:56:30.426 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-08-23T00:56:30.955 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-joblib. 2023-08-23T00:56:30.976 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../62-python3-joblib_0.14.0-3_all.deb ... 2023-08-23T00:56:31.013 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-08-23T00:56:31.434 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-sklearn. 2023-08-23T00:56:31.452 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../63-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-08-23T00:56:31.492 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-08-23T00:56:32.283 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-08-23T00:56:32.302 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../64-ceph-mgr-diskprediction-local_16.2.13-560-g21b2d401-1focal_all.deb ... 2023-08-23T00:56:32.342 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-diskprediction-local (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:33.485 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-cachetools. 2023-08-23T00:56:33.503 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../65-python3-cachetools_4.0.0-1_all.deb ... 2023-08-23T00:56:33.569 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-08-23T00:56:33.905 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyasn1. 2023-08-23T00:56:33.922 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../66-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-08-23T00:56:33.963 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-08-23T00:56:34.316 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-08-23T00:56:34.333 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../67-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-08-23T00:56:34.374 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-08-23T00:56:34.702 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-rsa. 2023-08-23T00:56:34.721 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../68-python3-rsa_4.0-3_all.deb ... 2023-08-23T00:56:34.760 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-rsa (4.0-3) ... 2023-08-23T00:56:35.222 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-google-auth. 2023-08-23T00:56:35.239 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../69-python3-google-auth_1.5.1-2_all.deb ... 2023-08-23T00:56:35.280 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-08-23T00:56:35.633 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-blinker. 2023-08-23T00:56:35.651 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../70-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-08-23T00:56:35.707 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-08-23T00:56:36.043 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-oauthlib. 2023-08-23T00:56:36.063 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../71-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-08-23T00:56:36.101 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-08-23T00:56:36.455 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-08-23T00:56:36.472 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../72-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-08-23T00:56:36.513 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-08-23T00:56:36.849 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-websocket. 2023-08-23T00:56:36.866 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../73-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-08-23T00:56:36.907 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-08-23T00:56:37.244 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-kubernetes. 2023-08-23T00:56:37.265 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../74-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-08-23T00:56:37.293 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-08-23T00:56:37.948 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-08-23T00:56:37.967 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../75-ceph-mgr-k8sevents_16.2.13-560-g21b2d401-1focal_all.deb ... 2023-08-23T00:56:38.006 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-mgr-k8sevents (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:38.334 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libonig5:amd64. 2023-08-23T00:56:38.353 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../76-libonig5_6.9.4-1_amd64.deb ... 2023-08-23T00:56:38.393 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-08-23T00:56:38.778 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libjq1:amd64. 2023-08-23T00:56:38.795 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../77-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-08-23T00:56:38.836 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-08-23T00:56:39.114 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package jq. 2023-08-23T00:56:39.131 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../78-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-08-23T00:56:39.172 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-08-23T00:56:39.466 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package socat. 2023-08-23T00:56:39.485 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../79-socat_1.7.3.3-2_amd64.deb ... 2023-08-23T00:56:39.524 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking socat (1.7.3.3-2) ... 2023-08-23T00:56:39.852 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package xmlstarlet. 2023-08-23T00:56:39.870 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../80-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-08-23T00:56:39.944 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-08-23T00:56:40.558 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package ceph-test. 2023-08-23T00:56:40.576 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../81-ceph-test_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:40.641 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking ceph-test (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:45.020 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package libcephfs-dev. 2023-08-23T00:56:45.040 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../82-libcephfs-dev_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:45.078 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking libcephfs-dev (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:45.782 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package nvme-cli. 2023-08-23T00:56:45.802 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../83-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-08-23T00:56:45.857 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-08-23T00:56:46.212 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-atomicwrites. 2023-08-23T00:56:46.233 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../84-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-08-23T00:56:46.271 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-08-23T00:56:46.604 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-attr. 2023-08-23T00:56:46.621 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../85-python3-attr_19.3.0-2_all.deb ... 2023-08-23T00:56:46.662 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-08-23T00:56:46.998 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-webencodings. 2023-08-23T00:56:47.015 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../86-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-08-23T00:56:47.090 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-08-23T00:56:47.417 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-html5lib. 2023-08-23T00:56:47.437 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../87-python3-html5lib_1.0.1-2_all.deb ... 2023-08-23T00:56:47.475 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-08-23T00:56:47.845 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-08-23T00:56:47.863 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../88-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-08-23T00:56:47.903 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-08-23T00:56:48.390 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-packaging. 2023-08-23T00:56:48.407 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../89-python3-packaging_20.3-1_all.deb ... 2023-08-23T00:56:48.448 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-packaging (20.3-1) ... 2023-08-23T00:56:48.784 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pastescript. 2023-08-23T00:56:48.805 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../90-python3-pastescript_2.0.2-4_all.deb ... 2023-08-23T00:56:48.992 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-08-23T00:56:49.339 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pluggy. 2023-08-23T00:56:49.358 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../91-python3-pluggy_0.13.0-2_all.deb ... 2023-08-23T00:56:49.397 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-08-23T00:56:49.742 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-psutil. 2023-08-23T00:56:49.759 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../92-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-08-23T00:56:49.801 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-08-23T00:56:50.157 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-py. 2023-08-23T00:56:50.175 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../93-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-08-23T00:56:50.215 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-08-23T00:56:50.560 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pyinotify. 2023-08-23T00:56:50.579 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../94-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-08-23T00:56:50.643 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-08-23T00:56:50.987 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-wcwidth. 2023-08-23T00:56:51.004 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../95-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-08-23T00:56:51.052 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-08-23T00:56:51.364 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-pytest. 2023-08-23T00:56:51.382 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../96-python3-pytest_4.6.9-1_all.deb ... 2023-08-23T00:56:51.413 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-08-23T00:56:51.767 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package python3-simplejson. 2023-08-23T00:56:51.783 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../97-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-08-23T00:56:51.824 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-08-23T00:56:52.261 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package radosgw. 2023-08-23T00:56:52.281 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../98-radosgw_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:52.319 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking radosgw (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:53.540 INFO:teuthology.orchestra.run.smithi012.stdout:Selecting previously unselected package rbd-fuse. 2023-08-23T00:56:53.560 INFO:teuthology.orchestra.run.smithi012.stdout:Preparing to unpack .../99-rbd-fuse_16.2.13-560-g21b2d401-1focal_amd64.deb ... 2023-08-23T00:56:53.598 INFO:teuthology.orchestra.run.smithi012.stdout:Unpacking rbd-fuse (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:53.930 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-attr (19.3.0-2) ... 2023-08-23T00:56:54.236 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2023-08-23T00:56:54.362 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-08-23T00:56:54.530 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-08-23T00:56:54.731 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up cephadm (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:55.400 INFO:teuthology.orchestra.run.smithi012.stdout:Adding system user cephadm....done 2023-08-23T00:56:55.562 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-08-23T00:56:55.930 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-08-23T00:56:56.214 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-08-23T00:56:56.382 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-08-23T00:56:56.725 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-08-23T00:56:57.144 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-08-23T00:56:57.436 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-08-23T00:56:57.704 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-08-23T00:56:57.972 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-08-23T00:56:58.281 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-ceph-argparse (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:56:58.616 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-08-23T00:56:58.775 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-08-23T00:56:59.076 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-08-23T00:56:59.377 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-08-23T00:56:59.805 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-08-23T00:57:00.064 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-08-23T00:57:00.462 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-08-23T00:57:00.742 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libjaeger (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:00.926 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-08-23T00:57:01.252 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-08-23T00:57:01.578 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-packaging (20.3-1) ... 2023-08-23T00:57:01.896 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-08-23T00:57:01.997 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-08-23T00:57:02.273 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-08-23T00:57:02.675 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-08-23T00:57:03.026 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-08-23T00:57:03.395 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up socat (1.7.3.3-2) ... 2023-08-23T00:57:03.521 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-ceph-common (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:03.830 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-08-23T00:57:04.173 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-08-23T00:57:04.291 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-08-23T00:57:04.450 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-08-23T00:57:04.743 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-08-23T00:57:05.077 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-08-23T00:57:05.204 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-08-23T00:57:05.530 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-08-23T00:57:05.823 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-08-23T00:57:06.132 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-08-23T00:57:06.258 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-08-23T00:57:06.542 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-08-23T00:57:06.951 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-08-23T00:57:07.261 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-08-23T00:57:07.668 INFO:teuthology.orchestra.run.smithi012.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-08-23T00:57:07.955 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-08-23T00:57:08.081 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-08-23T00:57:08.399 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-08-23T00:57:08.767 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-08-23T00:57:08.885 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-08-23T00:57:09.019 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-08-23T00:57:09.346 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-08-23T00:57:09.664 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librados2 (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:09.790 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-08-23T00:57:11.304 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librgw2 (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:11.456 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libsqlite3-mod-ceph (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:11.582 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-08-23T00:57:11.733 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-08-23T00:57:12.126 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-08-23T00:57:12.402 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-08-23T00:57:12.695 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-08-23T00:57:13.063 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libcephfs2 (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:13.214 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-08-23T00:57:13.544 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libradosstriper1 (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:13.670 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-08-23T00:57:14.005 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-08-23T00:57:15.085 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up librbd1 (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:15.186 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-08-23T00:57:15.329 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-08-23T00:57:15.455 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rsa (4.0-3) ... 2023-08-23T00:57:15.747 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-08-23T00:57:16.033 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-modules-core (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:16.159 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-fuse (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:16.723 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-08-23T00:57:16.723 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-08-23T00:57:17.177 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up libcephfs-dev (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:17.286 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-08-23T00:57:17.571 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-08-23T00:57:17.900 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-08-23T00:57:18.253 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rados (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:18.379 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rbd (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:18.530 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up rbd-fuse (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:18.657 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-routes (2.4.1-2) ... 2023-08-23T00:57:18.965 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-08-23T00:57:19.371 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-rgw (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:19.530 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-cephfs (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:19.815 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-08-23T00:57:20.785 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-common (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:21.364 INFO:teuthology.orchestra.run.smithi012.stdout:Adding group ceph....done 2023-08-23T00:57:21.766 INFO:teuthology.orchestra.run.smithi012.stdout:Adding system user ceph....done 2023-08-23T00:57:21.940 INFO:teuthology.orchestra.run.smithi012.stdout:Setting system user ceph properties....done 2023-08-23T00:57:21.994 INFO:teuthology.orchestra.run.smithi012.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-08-23T00:57:22.149 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-08-23T00:57:22.461 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-08-23T00:57:22.937 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-test (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:23.096 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up radosgw (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:23.377 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-08-23T00:57:23.378 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-08-23T00:57:24.048 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-base (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:24.469 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-08-23T00:57:24.925 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mds (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:25.151 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-08-23T00:57:25.151 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-08-23T00:57:25.626 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:25.866 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-08-23T00:57:25.866 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-08-23T00:57:26.344 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-osd (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:26.857 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-08-23T00:57:26.857 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-08-23T00:57:27.340 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-k8sevents (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:27.475 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-diskprediction-local (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:27.593 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mon (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:27.805 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-08-23T00:57:27.805 INFO:teuthology.orchestra.run.smithi012.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-08-23T00:57:28.253 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-cephadm (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:28.396 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:28.563 INFO:teuthology.orchestra.run.smithi012.stdout:Setting up ceph-mgr-dashboard (16.2.13-560-g21b2d401-1focal) ... 2023-08-23T00:57:28.707 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-08-23T00:57:28.994 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-08-23T00:57:32.014 INFO:teuthology.orchestra.run.smithi012.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-08-23T00:57:32.498 INFO:teuthology.orchestra.run.smithi012.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-08-23T00:57:32.501 DEBUG:teuthology.parallel:result is None 2023-08-23T00:57:32.502 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=21b2d401852937440c3da8ce2b19224181760caa 2023-08-23T00:57:32.758 DEBUG:teuthology.orchestra.run.smithi012:> dpkg-query -W -f '${Version}' ceph 2023-08-23T00:57:32.782 INFO:teuthology.orchestra.run.smithi012.stdout:16.2.13-560-g21b2d401-1focal 2023-08-23T00:57:32.782 INFO:teuthology.packaging:The installed version of ceph is 16.2.13-560-g21b2d401-1focal 2023-08-23T00:57:32.783 INFO:teuthology.task.install:The correct ceph version 16.2.13-560-g21b2d401-1focal is installed. 2023-08-23T00:57:32.783 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-23T00:57:32.804 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:32.805 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-23T00:57:32.870 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-23T00:57:32.870 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:32.870 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/daemon-helper 2023-08-23T00:57:32.886 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-23T00:57:32.942 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-23T00:57:32.943 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:32.943 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-23T00:57:32.955 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-23T00:57:32.968 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-23T00:57:32.969 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:32.970 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/usr/bin/stdin-killer 2023-08-23T00:57:33.026 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-23T00:57:33.038 INFO:teuthology.run_tasks:Running task ceph... 2023-08-23T00:57:33.130 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-23T00:57:33.131 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 777 /var/log/ceph 2023-08-23T00:57:33.147 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-23T00:57:33.148 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-23T00:57:33.206 INFO:tasks.ceph:Creating extra log directories... 2023-08-23T00:57:33.206 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-23T00:57:33.224 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-23T00:57:33.225 INFO:tasks.ceph:config {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-23T00:57:33.225 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-08-22_18:59:01-rbd-pacific-release-distro-default-smithi/7376986', 'branch': 'pacific-release', 'description': 'rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic}', 'email': None, 'first_in_suite': False, 'job_id': '7376986', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-08-22_18:59:01-rbd-pacific-release-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'pacific-release'}, 'ceph': {'conf': {'client': {'rbd default format': 1}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(CACHE_POOL_NEAR_FULL\\)', '\\(CACHE_POOL_NO_HIT_SET\\)'], 'sha1': '21b2d401852937440c3da8ce2b19224181760caa'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'global': {'osd crush chooseleaf type': 0, 'osd pool default pg num': 128, 'osd pool default pgp num': 128, 'osd pool default size': 2}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '21b2d401852937440c3da8ce2b19224181760caa'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'pacific-release', 'sha1': '21b2d401852937440c3da8ce2b19224181760caa'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'osd.2', 'client.0']], 'seed': 8823, 'sha1': '21b2d401852937440c3da8ce2b19224181760caa', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rbd', 'suite_branch': 'pacific-release', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '21b2d401852937440c3da8ce2b19224181760caa', 'targets': {'smithi012.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'exec': {'client.0': ['sudo ceph osd pool create cache 4', 'sudo ceph osd tier add rbd cache', 'sudo ceph osd tier cache-mode cache writeback', 'sudo ceph osd tier set-overlay rbd cache', 'sudo ceph osd pool set cache hit_set_type bloom', 'sudo ceph osd pool set cache hit_set_count 8', 'sudo ceph osd pool set cache hit_set_period 60', 'sudo ceph osd pool set cache target_max_objects 250']}}, {'workunit': {'clients': {'client.0': ['rbd/cli_generic.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '449a1bc2027504e7b3c3d7b30fa4178906581da7', 'timestamp': '2023-08-22_18:59:01', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2224'} 2023-08-23T00:57:33.226 DEBUG:teuthology.orchestra.run.smithi012:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-23T00:57:33.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo install -d -m0777 -- /var/run/ceph 2023-08-23T00:57:33.291 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:33.292 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/scratch_devs of=/dev/stdout 2023-08-23T00:57:33.300 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-23T00:57:33.300 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_1 2023-08-23T00:57:33.350 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-23T00:57:33.351 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-23T00:57:33.351 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 359 Links: 1 2023-08-23T00:57:33.351 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-23T00:57:33.351 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-08-23 00:53:39.458408473 +0000 2023-08-23T00:57:33.351 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-08-23 00:53:39.150415576 +0000 2023-08-23T00:57:33.351 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-08-23 00:53:39.150415576 +0000 2023-08-23T00:57:33.352 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-08-23T00:57:33.352 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-23T00:57:33.368 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-08-23T00:57:33.368 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-08-23T00:57:33.368 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000446497 s, 1.1 MB/s 2023-08-23T00:57:33.369 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-23T00:57:33.378 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_2 2023-08-23T00:57:33.384 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-23T00:57:33.385 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-23T00:57:33.385 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 366 Links: 1 2023-08-23T00:57:33.385 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-23T00:57:33.385 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-08-23 00:53:39.990396204 +0000 2023-08-23T00:57:33.385 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-08-23 00:53:39.690403123 +0000 2023-08-23T00:57:33.385 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-08-23 00:53:39.690403123 +0000 2023-08-23T00:57:33.385 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-08-23T00:57:33.386 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-23T00:57:33.442 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-08-23T00:57:33.442 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-08-23T00:57:33.442 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000403131 s, 1.3 MB/s 2023-08-23T00:57:33.443 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-23T00:57:33.450 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_3 2023-08-23T00:57:33.457 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-23T00:57:33.457 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-23T00:57:33.457 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 374 Links: 1 2023-08-23T00:57:33.457 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-23T00:57:33.458 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-08-23 00:53:40.562383014 +0000 2023-08-23T00:57:33.458 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-08-23 00:53:40.278389564 +0000 2023-08-23T00:57:33.458 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-08-23 00:53:40.278389564 +0000 2023-08-23T00:57:33.458 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-08-23T00:57:33.458 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-23T00:57:33.514 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-08-23T00:57:33.514 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-08-23T00:57:33.514 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000406274 s, 1.3 MB/s 2023-08-23T00:57:33.515 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-23T00:57:33.523 DEBUG:teuthology.orchestra.run.smithi012:> stat /dev/vg_nvme/lv_4 2023-08-23T00:57:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-23T00:57:33.529 INFO:teuthology.orchestra.run.smithi012.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-23T00:57:33.529 INFO:teuthology.orchestra.run.smithi012.stdout:Device: 6h/6d Inode: 377 Links: 1 2023-08-23T00:57:33.530 INFO:teuthology.orchestra.run.smithi012.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-23T00:57:33.530 INFO:teuthology.orchestra.run.smithi012.stdout:Access: 2023-08-23 00:53:40.782377941 +0000 2023-08-23T00:57:33.530 INFO:teuthology.orchestra.run.smithi012.stdout:Modify: 2023-08-23 00:53:40.778378032 +0000 2023-08-23T00:57:33.530 INFO:teuthology.orchestra.run.smithi012.stdout:Change: 2023-08-23 00:53:40.778378032 +0000 2023-08-23T00:57:33.530 INFO:teuthology.orchestra.run.smithi012.stdout: Birth: - 2023-08-23T00:57:33.530 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-23T00:57:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records in 2023-08-23T00:57:33.586 INFO:teuthology.orchestra.run.smithi012.stderr:1+0 records out 2023-08-23T00:57:33.587 INFO:teuthology.orchestra.run.smithi012.stderr:512 bytes copied, 0.000419721 s, 1.2 MB/s 2023-08-23T00:57:33.587 DEBUG:teuthology.orchestra.run.smithi012:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-23T00:57:33.595 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-08-23T00:57:33.596 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-08-23T00:57:33.596 INFO:tasks.ceph:Generating config... 2023-08-23T00:57:33.607 INFO:tasks.ceph:[client] rbd default format = 1 2023-08-23T00:57:33.607 INFO:tasks.ceph:[global] mon client directed command retry = 5 2023-08-23T00:57:33.608 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2023-08-23T00:57:33.608 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-23T00:57:33.608 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-23T00:57:33.608 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-23T00:57:33.609 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-23T00:57:33.609 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-23T00:57:33.609 INFO:tasks.ceph:[osd] bdev async discard = True 2023-08-23T00:57:33.609 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-08-23T00:57:33.609 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2023-08-23T00:57:33.610 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-23T00:57:33.610 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-23T00:57:33.610 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-08-23T00:57:33.610 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-08-23T00:57:33.610 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-23T00:57:33.611 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-23T00:57:33.611 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-08-23T00:57:33.611 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-23T00:57:33.611 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-23T00:57:33.611 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-23T00:57:33.612 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-23T00:57:33.612 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-23T00:57:33.612 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2023-08-23T00:57:33.612 INFO:tasks.ceph:Setting up mon.a... 2023-08-23T00:57:33.613 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-23T00:57:33.656 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.keyring 2023-08-23T00:57:33.659 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-23T00:57:33.736 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-23T00:57:33.753 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.12')] 2023-08-23T00:57:33.754 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.12', 'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd default format': 1}, 'mon.a': {}} 2023-08-23T00:57:33.756 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:33.757 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-23T00:57:33.765 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.12 --print /home/ubuntu/cephtest/ceph.monmap 2023-08-23T00:57:33.838 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-23T00:57:33.839 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: generated fsid 60709aa8-8ef6-453d-a210-09a154c4f279 2023-08-23T00:57:33.839 INFO:teuthology.orchestra.run.smithi012.stdout:epoch 0 2023-08-23T00:57:33.839 INFO:teuthology.orchestra.run.smithi012.stdout:fsid 60709aa8-8ef6-453d-a210-09a154c4f279 2023-08-23T00:57:33.839 INFO:teuthology.orchestra.run.smithi012.stdout:last_changed 2023-08-23T00:57:33.836163+0000 2023-08-23T00:57:33.840 INFO:teuthology.orchestra.run.smithi012.stdout:created 2023-08-23T00:57:33.836163+0000 2023-08-23T00:57:33.840 INFO:teuthology.orchestra.run.smithi012.stdout:min_mon_release 0 (unknown) 2023-08-23T00:57:33.840 INFO:teuthology.orchestra.run.smithi012.stdout:election_strategy: 1 2023-08-23T00:57:33.841 INFO:teuthology.orchestra.run.smithi012.stdout:0: [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] mon.a 2023-08-23T00:57:33.841 INFO:teuthology.orchestra.run.smithi012.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2023-08-23T00:57:33.843 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-23T00:57:33.849 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 60709aa8-8ef6-453d-a210-09a154c4f279... 2023-08-23T00:57:33.850 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-23T00:57:33.887 INFO:teuthology.orchestra.run.smithi012.stdout:[global] 2023-08-23T00:57:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: chdir = "" 2023-08-23T00:57:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-23T00:57:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: auth supported = cephx 2023-08-23T00:57:33.888 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: filestore xattr use omap = true 2023-08-23T00:57:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: mon clock drift allowed = 1.000 2023-08-23T00:57:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: osd crush chooseleaf type = 0 2023-08-23T00:57:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: auth debug = true 2023-08-23T00:57:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.889 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on old message = true 2023-08-23T00:57:33.890 INFO:teuthology.orchestra.run.smithi012.stdout: ms die on bug = true 2023-08-23T00:57:33.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.890 INFO:teuthology.orchestra.run.smithi012.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-23T00:57:33.890 INFO:teuthology.orchestra.run.smithi012.stdout: mon pg warn max object skew = 0 2023-08-23T00:57:33.890 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.890 INFO:teuthology.orchestra.run.smithi012.stdout: # disable pg_autoscaler by default for new pools 2023-08-23T00:57:33.890 INFO:teuthology.orchestra.run.smithi012.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-23T00:57:33.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.891 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default size = 2 2023-08-23T00:57:33.891 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.891 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow primary affinity = true 2023-08-23T00:57:33.891 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd allow pg remap = true 2023-08-23T00:57:33.891 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on legacy crush tunables = false 2023-08-23T00:57:33.891 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on crush straw calc version zero = false 2023-08-23T00:57:33.891 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on no sortbitwise = false 2023-08-23T00:57:33.892 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on osd down out interval zero = false 2023-08-23T00:57:33.892 INFO:teuthology.orchestra.run.smithi012.stdout: mon warn on too few osds = false 2023-08-23T00:57:33.892 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-23T00:57:33.892 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-23T00:57:33.892 INFO:teuthology.orchestra.run.smithi012.stdout: mon_allow_pool_size_one = true 2023-08-23T00:57:33.892 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.892 INFO:teuthology.orchestra.run.smithi012.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2023-08-23T00:57:33.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.893 INFO:teuthology.orchestra.run.smithi012.stdout: osd default data pool replay window = 5 2023-08-23T00:57:33.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.893 INFO:teuthology.orchestra.run.smithi012.stdout: mon allow pool delete = true 2023-08-23T00:57:33.893 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.893 INFO:teuthology.orchestra.run.smithi012.stdout: mon cluster log file level = debug 2023-08-23T00:57:33.893 INFO:teuthology.orchestra.run.smithi012.stdout: debug asserts on shutdown = true 2023-08-23T00:57:33.894 INFO:teuthology.orchestra.run.smithi012.stdout: mon health detail to clog = false 2023-08-23T00:57:33.894 INFO:teuthology.orchestra.run.smithi012.stdout: mon host = 172.21.15.12 2023-08-23T00:57:33.894 INFO:teuthology.orchestra.run.smithi012.stdout: mon client directed command retry = 5 2023-08-23T00:57:33.894 INFO:teuthology.orchestra.run.smithi012.stdout: ms inject socket failures = 5000 2023-08-23T00:57:33.894 INFO:teuthology.orchestra.run.smithi012.stdout: fsid = 60709aa8-8ef6-453d-a210-09a154c4f279 2023-08-23T00:57:33.894 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.895 INFO:teuthology.orchestra.run.smithi012.stdout:[osd] 2023-08-23T00:57:33.895 INFO:teuthology.orchestra.run.smithi012.stdout: osd journal size = 100 2023-08-23T00:57:33.895 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.895 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub load threshold = 5.0 2023-08-23T00:57:33.895 INFO:teuthology.orchestra.run.smithi012.stdout: osd scrub max interval = 600 2023-08-23T00:57:33.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.896 INFO:teuthology.orchestra.run.smithi012.stdout: osd recover clone overlap = true 2023-08-23T00:57:33.896 INFO:teuthology.orchestra.run.smithi012.stdout: osd recovery max chunk = 1048576 2023-08-23T00:57:33.896 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.896 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug shutdown = true 2023-08-23T00:57:33.897 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug op order = true 2023-08-23T00:57:33.897 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug verify stray on activate = true 2023-08-23T00:57:33.897 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.899 INFO:teuthology.orchestra.run.smithi012.stdout: osd open classes on start = true 2023-08-23T00:57:33.899 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug pg log writeout = true 2023-08-23T00:57:33.899 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.900 INFO:teuthology.orchestra.run.smithi012.stdout: osd deep scrub update digest min age = 30 2023-08-23T00:57:33.900 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.900 INFO:teuthology.orchestra.run.smithi012.stdout: osd map max advance = 10 2023-08-23T00:57:33.900 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.900 INFO:teuthology.orchestra.run.smithi012.stdout: journal zero on create = true 2023-08-23T00:57:33.900 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.900 INFO:teuthology.orchestra.run.smithi012.stdout: filestore ondisk finisher threads = 3 2023-08-23T00:57:33.901 INFO:teuthology.orchestra.run.smithi012.stdout: filestore apply finisher threads = 3 2023-08-23T00:57:33.901 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.901 INFO:teuthology.orchestra.run.smithi012.stdout: bdev debug aio = true 2023-08-23T00:57:33.901 INFO:teuthology.orchestra.run.smithi012.stdout: osd debug misdirected ops = true 2023-08-23T00:57:33.901 INFO:teuthology.orchestra.run.smithi012.stdout: bdev async discard = True 2023-08-23T00:57:33.902 INFO:teuthology.orchestra.run.smithi012.stdout: bdev enable discard = True 2023-08-23T00:57:33.902 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore allocator = stupid 2023-08-23T00:57:33.902 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore block size = 96636764160 2023-08-23T00:57:33.902 INFO:teuthology.orchestra.run.smithi012.stdout: bluestore fsck on mount = True 2023-08-23T00:57:33.903 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluefs = 1/20 2023-08-23T00:57:33.903 INFO:teuthology.orchestra.run.smithi012.stdout: debug bluestore = 1/20 2023-08-23T00:57:33.904 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-08-23T00:57:33.904 INFO:teuthology.orchestra.run.smithi012.stdout: debug osd = 20 2023-08-23T00:57:33.904 INFO:teuthology.orchestra.run.smithi012.stdout: debug rocksdb = 4/10 2023-08-23T00:57:33.905 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd backfillfull_ratio = 0.85 2023-08-23T00:57:33.905 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd full ratio = 0.9 2023-08-23T00:57:33.905 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd nearfull ratio = 0.8 2023-08-23T00:57:33.905 INFO:teuthology.orchestra.run.smithi012.stdout: osd failsafe full ratio = 0.95 2023-08-23T00:57:33.906 INFO:teuthology.orchestra.run.smithi012.stdout: osd objectstore = bluestore 2023-08-23T00:57:33.906 INFO:teuthology.orchestra.run.smithi012.stdout: osd shutdown pgref assert = True 2023-08-23T00:57:33.906 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.906 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr] 2023-08-23T00:57:33.907 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-08-23T00:57:33.907 INFO:teuthology.orchestra.run.smithi012.stdout: debug mgr = 20 2023-08-23T00:57:33.907 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2023-08-23T00:57:33.907 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2023-08-23T00:57:33.908 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2023-08-23T00:57:33.908 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2023-08-23T00:57:33.908 INFO:teuthology.orchestra.run.smithi012.stdout: mgr/telemetry/nag = false 2023-08-23T00:57:33.908 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.908 INFO:teuthology.orchestra.run.smithi012.stdout:[mon] 2023-08-23T00:57:33.908 INFO:teuthology.orchestra.run.smithi012.stdout: debug ms = 1 2023-08-23T00:57:33.908 INFO:teuthology.orchestra.run.smithi012.stdout: debug mon = 20 2023-08-23T00:57:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: debug paxos = 20 2023-08-23T00:57:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: debug auth = 20 2023-08-23T00:57:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: mon data avail warn = 5 2023-08-23T00:57:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: mon mgr mkfs grace = 240 2023-08-23T00:57:33.909 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min pgs per osd = 4 2023-08-23T00:57:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd reporter subtree level = osd 2023-08-23T00:57:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: mon osd prime pg temp = true 2023-08-23T00:57:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: mon reweight min bytes per osd = 10 2023-08-23T00:57:33.910 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-23T00:57:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: auth mon ticket ttl = 660 # 11m 2023-08-23T00:57:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: auth service ticket ttl = 240 # 4m 2023-08-23T00:57:33.911 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: # don't complain about insecure global_id in the test suite 2023-08-23T00:57:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-23T00:57:33.912 INFO:teuthology.orchestra.run.smithi012.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-23T00:57:33.913 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:33.913 INFO:teuthology.orchestra.run.smithi012.stdout:[client] 2023-08-23T00:57:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: rgw cache enabled = true 2023-08-23T00:57:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable ops log = true 2023-08-23T00:57:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: rgw enable usage log = true 2023-08-23T00:57:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-23T00:57:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-23T00:57:33.914 INFO:teuthology.orchestra.run.smithi012.stdout: rbd default format = 1 2023-08-23T00:57:33.914 INFO:teuthology.orchestra.run.smithi012.stdout:[mon.a] 2023-08-23T00:57:33.916 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-23T00:57:33.917 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-23T00:57:34.008 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-23T00:57:34.009 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:34.009 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-23T00:57:34.016 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:34.016 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-23T00:57:34.023 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi012.front.sepia.ceph.com 2023-08-23T00:57:34.023 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:34.023 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-23T00:57:34.024 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-23T00:57:34.047 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:34.048 DEBUG:teuthology.orchestra.run.smithi012:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-23T00:57:34.055 INFO:tasks.ceph:Setting up mon nodes... 2023-08-23T00:57:34.055 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-23T00:57:34.056 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-23T00:57:34.138 INFO:teuthology.orchestra.run.smithi012.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-23T00:57:34.141 INFO:tasks.ceph:Setting up mds nodes... 2023-08-23T00:57:34.142 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-23T00:57:34.142 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-23T00:57:34.175 INFO:teuthology.orchestra.run.smithi012.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-23T00:57:34.188 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-23T00:57:34.189 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi012.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}} 2023-08-23T00:57:34.190 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-23T00:57:34.205 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-08-23T00:57:34.205 INFO:tasks.ceph:role: osd.0 2023-08-23T00:57:34.205 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com 2023-08-23T00:57:34.206 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-23T00:57:34.740 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-23T00:57:34.741 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-23T00:57:34.741 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-23T00:57:34.741 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 2023-08-23T00:57:34.741 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-23T00:57:34.741 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-08-23T00:57:34.741 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-23T00:57:34.741 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-23T00:57:34.742 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-23T00:57:34.742 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-23T00:57:34.742 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-08-23T00:57:34.743 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-23T00:57:34.814 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-23T00:57:34.826 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2023-08-23T00:57:34.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-23T00:57:34.828 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-23T00:57:34.843 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-08-23T00:57:34.843 INFO:tasks.ceph:role: osd.1 2023-08-23T00:57:34.843 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com 2023-08-23T00:57:34.844 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-23T00:57:35.398 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-23T00:57:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-23T00:57:35.398 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-23T00:57:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 2023-08-23T00:57:35.399 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-23T00:57:35.399 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-08-23T00:57:35.399 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-23T00:57:35.399 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-23T00:57:35.400 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-23T00:57:35.400 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-23T00:57:35.401 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-08-23T00:57:35.401 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-23T00:57:35.435 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-23T00:57:35.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-23T00:57:35.445 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2023-08-23T00:57:35.445 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-23T00:57:35.457 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2023-08-23T00:57:35.457 INFO:tasks.ceph:role: osd.2 2023-08-23T00:57:35.458 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com 2023-08-23T00:57:35.458 DEBUG:teuthology.orchestra.run.smithi012:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-23T00:57:35.927 INFO:teuthology.orchestra.run.smithi012.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-23T00:57:35.928 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-23T00:57:35.928 INFO:teuthology.orchestra.run.smithi012.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-23T00:57:35.929 INFO:teuthology.orchestra.run.smithi012.stdout: = reflink=1 2023-08-23T00:57:35.929 INFO:teuthology.orchestra.run.smithi012.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-23T00:57:35.929 INFO:teuthology.orchestra.run.smithi012.stdout: = sunit=0 swidth=0 blks 2023-08-23T00:57:35.929 INFO:teuthology.orchestra.run.smithi012.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-23T00:57:35.929 INFO:teuthology.orchestra.run.smithi012.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-23T00:57:35.929 INFO:teuthology.orchestra.run.smithi012.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-23T00:57:35.930 INFO:teuthology.orchestra.run.smithi012.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-23T00:57:35.931 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi012.front.sepia.ceph.com -o noatime 2023-08-23T00:57:35.932 DEBUG:teuthology.orchestra.run.smithi012:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-23T00:57:35.986 DEBUG:teuthology.orchestra.run.smithi012:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-23T00:57:36.000 INFO:teuthology.orchestra.run.smithi012.stderr:sudo: /sbin/restorecon: command not found 2023-08-23T00:57:36.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-23T00:57:36.001 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-23T00:57:36.067 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:36.060+0000 7fc72583c080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-23T00:57:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:36.060+0000 7fc72583c080 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-23T00:57:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:36.060+0000 7fc72583c080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-23T00:57:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:36.060+0000 7fc72583c080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-23T00:57:36.068 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:36.064+0000 7fc72583c080 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-23T00:57:36.069 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:36.064+0000 7fc72583c080 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-23T00:57:39.044 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-23T00:57:39.059 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-23T00:57:39.143 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:39.135+0000 7fd495806080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-23T00:57:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:39.135+0000 7fd495806080 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-23T00:57:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:39.135+0000 7fd495806080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-23T00:57:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:39.139+0000 7fd495806080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-23T00:57:39.144 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:39.139+0000 7fd495806080 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-23T00:57:39.145 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:39.139+0000 7fd495806080 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-23T00:57:42.123 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-23T00:57:42.139 DEBUG:teuthology.orchestra.run.smithi012:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-23T00:57:42.175 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:42.167+0000 7f2c69e4c080 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-23T00:57:42.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:42.167+0000 7f2c69e4c080 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-23T00:57:42.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:42.167+0000 7f2c69e4c080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-23T00:57:42.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:42.167+0000 7f2c69e4c080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-23T00:57:42.176 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:42.167+0000 7f2c69e4c080 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-23T00:57:42.177 INFO:teuthology.orchestra.run.smithi012.stderr:2023-08-23T00:57:42.171+0000 7f2c69e4c080 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-23T00:57:45.163 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-23T00:57:45.220 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-23T00:57:45.221 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:45.221 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-23T00:57:45.232 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:45.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-23T00:57:45.245 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:45.245 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-23T00:57:45.258 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:45.259 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-23T00:57:45.271 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:45.272 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-23T00:57:45.321 INFO:tasks.ceph:Adding keys to all mons... 2023-08-23T00:57:45.322 DEBUG:teuthology.orchestra.run.smithi012:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-23T00:57:45.335 INFO:teuthology.orchestra.run.smithi012.stdout:[mgr.x] 2023-08-23T00:57:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQB+WeVk9LknCBAAkOx7Ki3jcyVrVFWn/geaLw== 2023-08-23T00:57:45.335 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.0] 2023-08-23T00:57:45.335 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCAWeVkfGvlAxAAnWNNpEud2M1Bl6OInJIvAw== 2023-08-23T00:57:45.335 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.1] 2023-08-23T00:57:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCDWeVkkYVtCBAA0Bn6qOcZSY6EFnvIAqgvXw== 2023-08-23T00:57:45.336 INFO:teuthology.orchestra.run.smithi012.stdout:[osd.2] 2023-08-23T00:57:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQCGWeVkDE5OChAAHM8qOeCi8c5c5//+4RgKRQ== 2023-08-23T00:57:45.336 INFO:teuthology.orchestra.run.smithi012.stdout:[client.0] 2023-08-23T00:57:45.336 INFO:teuthology.orchestra.run.smithi012.stdout: key = AQB+WeVkMs9YChAAzE+qpmH+6b941F09OpQcXA== 2023-08-23T00:57:45.337 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-23T00:57:45.376 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-23T00:57:45.462 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-23T00:57:45.505 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-23T00:57:45.549 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-23T00:57:45.588 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-23T00:57:45.589 DEBUG:teuthology.orchestra.run.smithi012:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-23T00:57:45.599 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-23T00:57:45.697 DEBUG:teuthology.orchestra.run.smithi012:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-23T00:57:45.713 DEBUG:teuthology.orchestra.run.smithi012:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-23T00:57:45.719 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-23T00:57:45.719 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-23T00:57:45.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-23T00:57:45.722 INFO:tasks.ceph.mon.a:Started 2023-08-23T00:57:45.722 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-23T00:57:45.722 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-23T00:57:45.723 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-23T00:57:45.725 INFO:tasks.ceph.mgr.x:Started 2023-08-23T00:57:45.725 INFO:tasks.ceph:Setting crush tunables to default 2023-08-23T00:57:45.725 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd crush tunables default 2023-08-23T00:57:45.966 INFO:teuthology.orchestra.run.smithi012.stderr:adjusted tunables profile to default 2023-08-23T00:57:45.978 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-23T00:57:45.978 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:45.979 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-23T00:57:45.994 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:45.995 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-23T00:57:46.008 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:57:46.008 DEBUG:teuthology.orchestra.run.smithi012:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-23T00:57:46.018 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd new 82094578-8914-447d-9b0d-98e9427ad2ab 0 2023-08-23T00:57:46.046 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:46.039+0000 7fbaf6407500 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-23T00:57:46.109 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:46.103+0000 7fbaf6407500 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-23T00:57:46.216 INFO:teuthology.orchestra.run.smithi012.stdout:0 2023-08-23T00:57:46.231 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd new bdcaa971-caac-4af7-aab0-0cb779d7789d 1 2023-08-23T00:57:46.427 INFO:teuthology.orchestra.run.smithi012.stdout:1 2023-08-23T00:57:46.445 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd new 9193f857-84af-48a5-beb2-57513930d5d0 2 2023-08-23T00:57:46.641 INFO:teuthology.orchestra.run.smithi012.stdout:2 2023-08-23T00:57:46.653 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-23T00:57:46.654 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-23T00:57:46.656 INFO:tasks.ceph.osd.0:Started 2023-08-23T00:57:46.657 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-23T00:57:46.657 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-23T00:57:46.659 INFO:tasks.ceph.osd.1:Started 2023-08-23T00:57:46.660 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-23T00:57:46.660 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-23T00:57:46.662 INFO:tasks.ceph.osd.2:Started 2023-08-23T00:57:46.663 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-23T00:57:46.829 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:46.823+0000 7fbaf6407500 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-23T00:57:46.838 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:46.838 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":5,"fsid":"60709aa8-8ef6-453d-a210-09a154c4f279","created":"2023-08-23T00:57:45.840621+0000","modified":"2023-08-23T00:57:46.635969+0000","last_up_change":"0.000000","last_in_change":"2023-08-23T00:57:46.635969+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"82094578-8914-447d-9b0d-98e9427ad2ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bdcaa971-caac-4af7-aab0-0cb779d7789d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9193f857-84af-48a5-beb2-57513930d5d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-23T00:57:46.851 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-23T00:57:46.852 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-23T00:57:47.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T00:57:47.023+0000 7fe9b0048080 -1 Falling back to public interface 2023-08-23T00:57:47.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T00:57:47.027+0000 7f0e52720080 -1 Falling back to public interface 2023-08-23T00:57:47.153 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-23T00:57:47.285 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-08-23T00:57:47.279+0000 7f2c7b2e0080 -1 Falling back to public interface 2023-08-23T00:57:47.328 INFO:teuthology.misc.health.smithi012.stdout: 2023-08-23T00:57:47.329 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":5,"fsid":"60709aa8-8ef6-453d-a210-09a154c4f279","created":"2023-08-23T00:57:45.840621+0000","modified":"2023-08-23T00:57:46.635969+0000","last_up_change":"0.000000","last_in_change":"2023-08-23T00:57:46.635969+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"82094578-8914-447d-9b0d-98e9427ad2ab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"bdcaa971-caac-4af7-aab0-0cb779d7789d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9193f857-84af-48a5-beb2-57513930d5d0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-23T00:57:47.341 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-08-23T00:57:47.445 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:47.439+0000 7fbaf6407500 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-23T00:57:47.617 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:47.611+0000 7fbaf6407500 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-23T00:57:47.869 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:47.863+0000 7fbaf6407500 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-23T00:57:48.039 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:48.031+0000 7fbaf6407500 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-23T00:57:48.094 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:48.087+0000 7fbaf6407500 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-23T00:57:48.164 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:48.159+0000 7fbaf6407500 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-23T00:57:48.225 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:48.219+0000 7fbaf6407500 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-23T00:57:48.549 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:48.543+0000 7fbaf6407500 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-23T00:57:48.713 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:48.707+0000 7fbaf6407500 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-23T00:57:48.970 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:48.963+0000 7fbaf6407500 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-23T00:57:49.147 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:49.139+0000 7fbaf6407500 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-23T00:57:49.271 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:49.263+0000 7fbaf6407500 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-23T00:57:49.330 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:49.323+0000 7fbaf6407500 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-23T00:57:49.482 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:49.475+0000 7fbaf6407500 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-23T00:57:49.578 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:49.571+0000 7fbaf6407500 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-23T00:57:49.862 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:49.855+0000 7fbaf6407500 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-23T00:57:49.926 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:49.919+0000 7fbaf6407500 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-23T00:57:50.662 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T00:57:50.655+0000 7f0e52720080 -1 osd.1 0 log_to_monitors {default=true} 2023-08-23T00:57:50.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T00:57:50.827+0000 7fe9b0048080 -1 osd.0 0 log_to_monitors {default=true} 2023-08-23T00:57:50.932 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-08-23T00:57:50.927+0000 7f2c7b2e0080 -1 osd.2 0 log_to_monitors {default=true} 2023-08-23T00:57:50.958 INFO:tasks.ceph.mgr.x.smithi012.stderr:2023-08-23T00:57:50.951+0000 7fbae0129700 -1 mgr.server handle_report got status from non-daemon mon.a 2023-08-23T00:57:52.023 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T00:57:52.015+0000 7f0e4dec0700 -1 osd.1 0 waiting for initial osdmap 2023-08-23T00:57:52.024 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-08-23T00:57:52.015+0000 7f2c782a5700 -1 osd.2 0 waiting for initial osdmap 2023-08-23T00:57:52.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T00:57:52.019+0000 7fe9ab7e8700 -1 osd.0 0 waiting for initial osdmap 2023-08-23T00:57:52.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T00:57:52.023+0000 7fe9a855c700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-23T00:57:52.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T00:57:52.023+0000 7f0e4ac34700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-23T00:57:52.031 INFO:tasks.ceph.osd.2.smithi012.stderr:2023-08-23T00:57:52.023+0000 7f2c737f4700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-23T00:57:53.644 DEBUG:teuthology.orchestra.run.smithi012:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-23T00:57:53.925 INFO:teuthology.misc.health.smithi012.stdout: 2023-08-23T00:57:53.925 INFO:teuthology.misc.health.smithi012.stdout:{"epoch":8,"fsid":"60709aa8-8ef6-453d-a210-09a154c4f279","created":"2023-08-23T00:57:45.840621+0000","modified":"2023-08-23T00:57:53.011690+0000","last_up_change":"2023-08-23T00:57:53.011690+0000","last_in_change":"2023-08-23T00:57:46.635969+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[],"osds":[{"osd":0,"uuid":"82094578-8914-447d-9b0d-98e9427ad2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":29704},{"type":"v1","addr":"172.21.15.12:6801","nonce":29704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":29704},{"type":"v1","addr":"172.21.15.12:6803","nonce":29704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":29704},{"type":"v1","addr":"172.21.15.12:6807","nonce":29704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":29704},{"type":"v1","addr":"172.21.15.12:6805","nonce":29704}]},"public_addr":"172.21.15.12:6801/29704","cluster_addr":"172.21.15.12:6803/29704","heartbeat_back_addr":"172.21.15.12:6807/29704","heartbeat_front_addr":"172.21.15.12:6805/29704","state":["exists","up"]},{"osd":1,"uuid":"bdcaa971-caac-4af7-aab0-0cb779d7789d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":29703},{"type":"v1","addr":"172.21.15.12:6809","nonce":29703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":29703},{"type":"v1","addr":"172.21.15.12:6811","nonce":29703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":29703},{"type":"v1","addr":"172.21.15.12:6815","nonce":29703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":29703},{"type":"v1","addr":"172.21.15.12:6813","nonce":29703}]},"public_addr":"172.21.15.12:6809/29703","cluster_addr":"172.21.15.12:6811/29703","heartbeat_back_addr":"172.21.15.12:6815/29703","heartbeat_front_addr":"172.21.15.12:6813/29703","state":["exists","up"]},{"osd":2,"uuid":"9193f857-84af-48a5-beb2-57513930d5d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":29705},{"type":"v1","addr":"172.21.15.12:6817","nonce":29705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":29705},{"type":"v1","addr":"172.21.15.12:6819","nonce":29705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":29705},{"type":"v1","addr":"172.21.15.12:6823","nonce":29705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":29705},{"type":"v1","addr":"172.21.15.12:6821","nonce":29705}]},"public_addr":"172.21.15.12:6817/29705","cluster_addr":"172.21.15.12:6819/29705","heartbeat_back_addr":"172.21.15.12:6823/29705","heartbeat_front_addr":"172.21.15.12:6821/29705","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-23T00:57:53.938 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-08-23T00:57:53.938 INFO:tasks.ceph:Creating RBD pool 2023-08-23T00:57:53.939 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd pool create rbd 8 2023-08-23T00:57:55.044 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'rbd' created 2023-08-23T00:57:55.056 DEBUG:teuthology.orchestra.run.smithi012:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-08-23T00:57:56.048 INFO:teuthology.orchestra.run.smithi012.stderr:enabled application 'rbd' on pool 'rbd' 2023-08-23T00:57:56.061 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-23T00:57:56.061 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-23T00:57:56.062 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-23T00:57:56.062 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-23T00:57:56.062 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-23T00:57:56.377 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:56.391 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":4,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6824","nonce":29517},{"type":"v1","addr":"172.21.15.12:6825","nonce":29517}]},"active_addr":"172.21.15.12:6825/29517","active_change":"2023-08-23T00:57:49.943327+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":3181284922}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.12:0","nonce":1476790428}]}]} 2023-08-23T00:57:56.393 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-23T00:57:56.394 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-23T00:57:56.394 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-23T00:57:56.672 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:56.673 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":11,"fsid":"60709aa8-8ef6-453d-a210-09a154c4f279","created":"2023-08-23T00:57:45.840621+0000","modified":"2023-08-23T00:57:56.026809+0000","last_up_change":"2023-08-23T00:57:53.011690+0000","last_in_change":"2023-08-23T00:57:46.635969+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-23T00:57:53.086533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-23T00:57:54.275193+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"82094578-8914-447d-9b0d-98e9427ad2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":29704},{"type":"v1","addr":"172.21.15.12:6801","nonce":29704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":29704},{"type":"v1","addr":"172.21.15.12:6803","nonce":29704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":29704},{"type":"v1","addr":"172.21.15.12:6807","nonce":29704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":29704},{"type":"v1","addr":"172.21.15.12:6805","nonce":29704}]},"public_addr":"172.21.15.12:6801/29704","cluster_addr":"172.21.15.12:6803/29704","heartbeat_back_addr":"172.21.15.12:6807/29704","heartbeat_front_addr":"172.21.15.12:6805/29704","state":["exists","up"]},{"osd":1,"uuid":"bdcaa971-caac-4af7-aab0-0cb779d7789d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":29703},{"type":"v1","addr":"172.21.15.12:6809","nonce":29703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":29703},{"type":"v1","addr":"172.21.15.12:6811","nonce":29703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":29703},{"type":"v1","addr":"172.21.15.12:6815","nonce":29703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":29703},{"type":"v1","addr":"172.21.15.12:6813","nonce":29703}]},"public_addr":"172.21.15.12:6809/29703","cluster_addr":"172.21.15.12:6811/29703","heartbeat_back_addr":"172.21.15.12:6815/29703","heartbeat_front_addr":"172.21.15.12:6813/29703","state":["exists","up"]},{"osd":2,"uuid":"9193f857-84af-48a5-beb2-57513930d5d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":29705},{"type":"v1","addr":"172.21.15.12:6817","nonce":29705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":29705},{"type":"v1","addr":"172.21.15.12:6819","nonce":29705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":29705},{"type":"v1","addr":"172.21.15.12:6823","nonce":29705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":29705},{"type":"v1","addr":"172.21.15.12:6821","nonce":29705}]},"public_addr":"172.21.15.12:6817/29705","cluster_addr":"172.21.15.12:6819/29705","heartbeat_back_addr":"172.21.15.12:6823/29705","heartbeat_front_addr":"172.21.15.12:6821/29705","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-23T00:57:51.810767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-23T00:57:51.685306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-23T00:57:51.897262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-23T00:57:56.686 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-23T00:57:56.687 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-23T00:57:56.965 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:56.965 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":11,"fsid":"60709aa8-8ef6-453d-a210-09a154c4f279","created":"2023-08-23T00:57:45.840621+0000","modified":"2023-08-23T00:57:56.026809+0000","last_up_change":"2023-08-23T00:57:53.011690+0000","last_in_change":"2023-08-23T00:57:46.635969+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-23T00:57:53.086533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-23T00:57:54.275193+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"82094578-8914-447d-9b0d-98e9427ad2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":29704},{"type":"v1","addr":"172.21.15.12:6801","nonce":29704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":29704},{"type":"v1","addr":"172.21.15.12:6803","nonce":29704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":29704},{"type":"v1","addr":"172.21.15.12:6807","nonce":29704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":29704},{"type":"v1","addr":"172.21.15.12:6805","nonce":29704}]},"public_addr":"172.21.15.12:6801/29704","cluster_addr":"172.21.15.12:6803/29704","heartbeat_back_addr":"172.21.15.12:6807/29704","heartbeat_front_addr":"172.21.15.12:6805/29704","state":["exists","up"]},{"osd":1,"uuid":"bdcaa971-caac-4af7-aab0-0cb779d7789d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":29703},{"type":"v1","addr":"172.21.15.12:6809","nonce":29703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":29703},{"type":"v1","addr":"172.21.15.12:6811","nonce":29703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":29703},{"type":"v1","addr":"172.21.15.12:6815","nonce":29703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":29703},{"type":"v1","addr":"172.21.15.12:6813","nonce":29703}]},"public_addr":"172.21.15.12:6809/29703","cluster_addr":"172.21.15.12:6811/29703","heartbeat_back_addr":"172.21.15.12:6815/29703","heartbeat_front_addr":"172.21.15.12:6813/29703","state":["exists","up"]},{"osd":2,"uuid":"9193f857-84af-48a5-beb2-57513930d5d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":29705},{"type":"v1","addr":"172.21.15.12:6817","nonce":29705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":29705},{"type":"v1","addr":"172.21.15.12:6819","nonce":29705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":29705},{"type":"v1","addr":"172.21.15.12:6823","nonce":29705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":29705},{"type":"v1","addr":"172.21.15.12:6821","nonce":29705}]},"public_addr":"172.21.15.12:6817/29705","cluster_addr":"172.21.15.12:6819/29705","heartbeat_back_addr":"172.21.15.12:6823/29705","heartbeat_front_addr":"172.21.15.12:6821/29705","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-23T00:57:51.810767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-23T00:57:51.685306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-23T00:57:51.897262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-23T00:57:56.978 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-23T00:57:57.128 INFO:teuthology.orchestra.run.smithi012.stdout:34359738371 2023-08-23T00:57:57.128 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-23T00:57:57.280 INFO:teuthology.orchestra.run.smithi012.stdout:34359738370 2023-08-23T00:57:57.280 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-23T00:57:57.432 INFO:teuthology.orchestra.run.smithi012.stdout:34359738370 2023-08-23T00:57:57.432 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-23T00:57:57.717 INFO:teuthology.orchestra.run.smithi012.stdout:34359738370 2023-08-23T00:57:57.731 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738370 for osd.0 2023-08-23T00:57:58.732 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-23T00:57:59.015 INFO:teuthology.orchestra.run.smithi012.stdout:34359738371 2023-08-23T00:57:59.029 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738371 got 34359738371 for osd.0 2023-08-23T00:57:59.029 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-23T00:57:59.309 INFO:teuthology.orchestra.run.smithi012.stdout:34359738370 2023-08-23T00:57:59.328 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738370 got 34359738370 for osd.1 2023-08-23T00:57:59.329 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-23T00:57:59.604 INFO:teuthology.orchestra.run.smithi012.stdout:34359738370 2023-08-23T00:57:59.618 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738370 got 34359738370 for osd.2 2023-08-23T00:57:59.618 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-23T00:57:59.618 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T00:57:59.882 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:57:59.885 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T00:57:59.895 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2023-08-23T00:57:57.952860+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":1,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":891576,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":891264,"kb_avail":282223944,"statfs":{"total":289910292480,"available":288997318656,"internally_reserved":0,"allocated":294912,"data_stored":78375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":912654336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.050129+0000","last_change":"2023-08-23T00:57:56.050129+0000","last_active":"2023-08-23T00:57:56.050129+0000","last_peered":"2023-08-23T00:57:56.050129+0000","last_clean":"2023-08-23T00:57:56.050129+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T00:57:56.050129+0000","last_undegraded":"2023-08-23T00:57:56.050129+0000","last_fullsized":"2023-08-23T00:57:56.050129+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.050130+0000","last_change":"2023-08-23T00:57:56.050130+0000","last_active":"2023-08-23T00:57:56.050130+0000","last_peered":"2023-08-23T00:57:56.050130+0000","last_clean":"2023-08-23T00:57:56.050130+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T00:57:56.050130+0000","last_undegraded":"2023-08-23T00:57:56.050130+0000","last_fullsized":"2023-08-23T00:57:56.050130+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.046996+0000","last_change":"2023-08-23T00:57:56.046996+0000","last_active":"2023-08-23T00:57:56.046996+0000","last_peered":"2023-08-23T00:57:56.046996+0000","last_clean":"2023-08-23T00:57:56.046996+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T00:57:56.046996+0000","last_undegraded":"2023-08-23T00:57:56.046996+0000","last_fullsized":"2023-08-23T00:57:56.046996+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.047122+0000","last_change":"2023-08-23T00:57:56.047122+0000","last_active":"2023-08-23T00:57:56.047122+0000","last_peered":"2023-08-23T00:57:56.047122+0000","last_clean":"2023-08-23T00:57:56.047122+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T00:57:56.047122+0000","last_undegraded":"2023-08-23T00:57:56.047122+0000","last_fullsized":"2023-08-23T00:57:56.047122+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.052370+0000","last_change":"2023-08-23T00:57:56.052370+0000","last_active":"2023-08-23T00:57:56.052370+0000","last_peered":"2023-08-23T00:57:56.052370+0000","last_clean":"2023-08-23T00:57:56.052370+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T00:57:56.052370+0000","last_undegraded":"2023-08-23T00:57:56.052370+0000","last_fullsized":"2023-08-23T00:57:56.052370+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.057170+0000","last_change":"2023-08-23T00:57:56.047593+0000","last_active":"2023-08-23T00:57:56.057170+0000","last_peered":"2023-08-23T00:57:56.057170+0000","last_clean":"2023-08-23T00:57:56.057170+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T00:57:56.057170+0000","last_undegraded":"2023-08-23T00:57:56.057170+0000","last_fullsized":"2023-08-23T00:57:56.057170+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.057108+0000","last_change":"2023-08-23T00:57:56.046904+0000","last_active":"2023-08-23T00:57:56.057108+0000","last_peered":"2023-08-23T00:57:56.057108+0000","last_clean":"2023-08-23T00:57:56.057108+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T00:57:56.057108+0000","last_undegraded":"2023-08-23T00:57:56.057108+0000","last_fullsized":"2023-08-23T00:57:56.057108+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.044200+0000","last_change":"2023-08-23T00:57:56.044200+0000","last_active":"2023-08-23T00:57:56.044200+0000","last_peered":"2023-08-23T00:57:56.044200+0000","last_clean":"2023-08-23T00:57:56.044200+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T00:57:56.044200+0000","last_undegraded":"2023-08-23T00:57:56.044200+0000","last_fullsized":"2023-08-23T00:57:56.044200+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":9,"reported_epoch":10,"state":"active+clean","last_fresh":"2023-08-23T00:57:55.043752+0000","last_change":"2023-08-23T00:57:55.042710+0000","last_active":"2023-08-23T00:57:55.043752+0000","last_peered":"2023-08-23T00:57:55.043752+0000","last_clean":"2023-08-23T00:57:55.043752+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T00:57:55.043752+0000","last_undegraded":"2023-08-23T00:57:55.043752+0000","last_fullsized":"2023-08-23T00:57:55.043752+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_clean_scrub_stamp":"2023-08-23T00:57:54.020645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738370,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297192,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074648,"statfs":{"total":96636764160,"available":96332439552,"internally_reserved":0,"allocated":98304,"data_stored":26125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},{"osd":1,"up_from":8,"seq":34359738370,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297192,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074648,"statfs":{"total":96636764160,"available":96332439552,"internally_reserved":0,"allocated":98304,"data_stored":26125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297192,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074648,"statfs":{"total":96636764160,"available":96332439552,"internally_reserved":0,"allocated":98304,"data_stored":26125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T00:57:59.896 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T00:58:00.186 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:58:00.189 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T00:58:00.199 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2023-08-23T00:57:59.953354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":891584,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":891264,"kb_avail":282223936,"statfs":{"total":289910292480,"available":288997310464,"internally_reserved":0,"allocated":303104,"data_stored":81904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":912654336},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.054580+0000","last_change":"2023-08-23T00:57:56.050129+0000","last_active":"2023-08-23T00:57:56.054580+0000","last_peered":"2023-08-23T00:57:56.054580+0000","last_clean":"2023-08-23T00:57:56.054580+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T00:57:56.054580+0000","last_undegraded":"2023-08-23T00:57:56.054580+0000","last_fullsized":"2023-08-23T00:57:56.054580+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.054589+0000","last_change":"2023-08-23T00:57:56.050130+0000","last_active":"2023-08-23T00:57:56.054589+0000","last_peered":"2023-08-23T00:57:56.054589+0000","last_clean":"2023-08-23T00:57:56.054589+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T00:57:56.054589+0000","last_undegraded":"2023-08-23T00:57:56.054589+0000","last_fullsized":"2023-08-23T00:57:56.054589+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.054330+0000","last_change":"2023-08-23T00:57:56.046996+0000","last_active":"2023-08-23T00:57:56.054330+0000","last_peered":"2023-08-23T00:57:56.054330+0000","last_clean":"2023-08-23T00:57:56.054330+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T00:57:56.054330+0000","last_undegraded":"2023-08-23T00:57:56.054330+0000","last_fullsized":"2023-08-23T00:57:56.054330+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.054380+0000","last_change":"2023-08-23T00:57:56.047122+0000","last_active":"2023-08-23T00:57:56.054380+0000","last_peered":"2023-08-23T00:57:56.054380+0000","last_clean":"2023-08-23T00:57:56.054380+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T00:57:56.054380+0000","last_undegraded":"2023-08-23T00:57:56.054380+0000","last_fullsized":"2023-08-23T00:57:56.054380+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.057529+0000","last_change":"2023-08-23T00:57:56.052370+0000","last_active":"2023-08-23T00:57:56.057529+0000","last_peered":"2023-08-23T00:57:56.057529+0000","last_clean":"2023-08-23T00:57:56.057529+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T00:57:56.057529+0000","last_undegraded":"2023-08-23T00:57:56.057529+0000","last_fullsized":"2023-08-23T00:57:56.057529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.057170+0000","last_change":"2023-08-23T00:57:56.047593+0000","last_active":"2023-08-23T00:57:56.057170+0000","last_peered":"2023-08-23T00:57:56.057170+0000","last_clean":"2023-08-23T00:57:56.057170+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T00:57:56.057170+0000","last_undegraded":"2023-08-23T00:57:56.057170+0000","last_fullsized":"2023-08-23T00:57:56.057170+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.057108+0000","last_change":"2023-08-23T00:57:56.046904+0000","last_active":"2023-08-23T00:57:56.057108+0000","last_peered":"2023-08-23T00:57:56.057108+0000","last_clean":"2023-08-23T00:57:56.057108+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T00:57:56.057108+0000","last_undegraded":"2023-08-23T00:57:56.057108+0000","last_fullsized":"2023-08-23T00:57:56.057108+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.051636+0000","last_change":"2023-08-23T00:57:56.044200+0000","last_active":"2023-08-23T00:57:56.051636+0000","last_peered":"2023-08-23T00:57:56.051636+0000","last_clean":"2023-08-23T00:57:56.051636+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T00:57:56.051636+0000","last_undegraded":"2023-08-23T00:57:56.051636+0000","last_fullsized":"2023-08-23T00:57:56.051636+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":10,"reported_epoch":11,"state":"active+clean","last_fresh":"2023-08-23T00:57:56.034941+0000","last_change":"2023-08-23T00:57:55.042710+0000","last_active":"2023-08-23T00:57:56.034941+0000","last_peered":"2023-08-23T00:57:56.034941+0000","last_clean":"2023-08-23T00:57:56.034941+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T00:57:56.034941+0000","last_undegraded":"2023-08-23T00:57:56.034941+0000","last_fullsized":"2023-08-23T00:57:56.034941+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_clean_scrub_stamp":"2023-08-23T00:57:54.020645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738371,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297200,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074640,"statfs":{"total":96636764160,"available":96332431360,"internally_reserved":0,"allocated":106496,"data_stored":29654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297192,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074648,"statfs":{"total":96636764160,"available":96332439552,"internally_reserved":0,"allocated":98304,"data_stored":26125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297192,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":94074648,"statfs":{"total":96636764160,"available":96332439552,"internally_reserved":0,"allocated":98304,"data_stored":26125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T00:58:00.200 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-23T00:58:00.200 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-23T00:58:00.200 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-23T00:58:00.201 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-23T00:58:00.511 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T00:58:00.524 INFO:teuthology.orchestra.run.smithi012.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-23T00:58:00.524 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-23T00:58:00.525 INFO:teuthology.run_tasks:Running task exec... 2023-08-23T00:58:00.535 INFO:teuthology.task.exec:Executing custom commands... 2023-08-23T00:58:00.536 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi012.front.sepia.ceph.com 2023-08-23T00:58:00.536 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool create cache 4' 2023-08-23T00:58:01.823 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cache' created 2023-08-23T00:58:01.835 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier add rbd cache' 2023-08-23T00:58:02.829 INFO:teuthology.orchestra.run.smithi012.stderr:pool 'cache' is now (or already was) a tier of 'rbd' 2023-08-23T00:58:02.845 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier cache-mode cache writeback' 2023-08-23T00:58:03.829 INFO:teuthology.orchestra.run.smithi012.stderr:set cache-mode for pool 'cache' to writeback 2023-08-23T00:58:03.843 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd tier set-overlay rbd cache' 2023-08-23T00:58:04.841 INFO:teuthology.orchestra.run.smithi012.stderr:overlay for 'rbd' is now (or already was) 'cache' 2023-08-23T00:58:04.855 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_type bloom' 2023-08-23T00:58:05.846 INFO:teuthology.orchestra.run.smithi012.stderr:set pool 3 hit_set_type to bloom 2023-08-23T00:58:05.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_count 8' 2023-08-23T00:58:06.851 INFO:teuthology.orchestra.run.smithi012.stderr:set pool 3 hit_set_count to 8 2023-08-23T00:58:06.866 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache hit_set_period 60' 2023-08-23T00:58:07.855 INFO:teuthology.orchestra.run.smithi012.stderr:set pool 3 hit_set_period to 60 2023-08-23T00:58:07.869 DEBUG:teuthology.orchestra.run.smithi012:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph osd pool set cache target_max_objects 250' 2023-08-23T00:58:08.864 INFO:teuthology.orchestra.run.smithi012.stderr:set pool 3 target_max_objects to 250 2023-08-23T00:58:08.878 INFO:teuthology.run_tasks:Running task workunit... 2023-08-23T00:58:08.910 INFO:tasks.workunit:Pulling workunits from ref 21b2d401852937440c3da8ce2b19224181760caa 2023-08-23T00:58:08.911 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-08-23T00:58:08.911 DEBUG:teuthology.orchestra.run.smithi012:> stat -- /home/ubuntu/cephtest/mnt.0 2023-08-23T00:58:08.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-23T00:58:08.919 INFO:teuthology.orchestra.run.smithi012.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2023-08-23T00:58:08.919 DEBUG:teuthology.orchestra.run.smithi012:> mkdir -- /home/ubuntu/cephtest/mnt.0 2023-08-23T00:58:08.925 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2023-08-23T00:58:08.926 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2023-08-23T00:58:08.974 INFO:tasks.workunit:timeout=3h 2023-08-23T00:58:08.974 INFO:tasks.workunit:cleanup=True 2023-08-23T00:58:08.975 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 21b2d401852937440c3da8ce2b19224181760caa 2023-08-23T00:58:08.984 INFO:tasks.workunit.client.0.smithi012.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-08-23T00:58:54.816 INFO:tasks.workunit.client.0.smithi012.stderr:Note: switching to '21b2d401852937440c3da8ce2b19224181760caa'. 2023-08-23T00:58:54.817 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-08-23T00:58:54.817 INFO:tasks.workunit.client.0.smithi012.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-08-23T00:58:54.817 INFO:tasks.workunit.client.0.smithi012.stderr:changes and commit them, and you can discard any commits you make in this 2023-08-23T00:58:54.817 INFO:tasks.workunit.client.0.smithi012.stderr:state without impacting any branches by switching back to a branch. 2023-08-23T00:58:54.817 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-08-23T00:58:54.817 INFO:tasks.workunit.client.0.smithi012.stderr:If you want to create a new branch to retain commits you create, you may 2023-08-23T00:58:54.817 INFO:tasks.workunit.client.0.smithi012.stderr:do so (now or later) by using -c with the switch command. Example: 2023-08-23T00:58:54.818 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-08-23T00:58:54.818 INFO:tasks.workunit.client.0.smithi012.stderr: git switch -c 2023-08-23T00:58:54.818 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-08-23T00:58:54.818 INFO:tasks.workunit.client.0.smithi012.stderr:Or undo this operation with: 2023-08-23T00:58:54.818 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-08-23T00:58:54.818 INFO:tasks.workunit.client.0.smithi012.stderr: git switch - 2023-08-23T00:58:54.818 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-08-23T00:58:54.818 INFO:tasks.workunit.client.0.smithi012.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-08-23T00:58:54.819 INFO:tasks.workunit.client.0.smithi012.stderr: 2023-08-23T00:58:54.819 INFO:tasks.workunit.client.0.smithi012.stderr:HEAD is now at 21b2d401852 Merge pull request #52979 from k0ste/wip-50915-pacific 2023-08-23T00:58:54.821 DEBUG:teuthology.orchestra.run.smithi012:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-08-23T00:58:54.854 INFO:tasks.workunit.client.0.smithi012.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-08-23T00:58:54.857 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-08-23T00:58:54.858 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-08-23T00:58:55.735 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-08-23T00:58:55.825 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-08-23T00:58:55.888 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-08-23T00:58:55.891 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-08-23T00:58:55.891 INFO:tasks.workunit.client.0.smithi012.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-08-23T00:58:55.948 INFO:tasks.workunit.client.0.smithi012.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-08-23T00:58:55.953 DEBUG:teuthology.orchestra.run.smithi012:> set -ex 2023-08-23T00:58:55.953 DEBUG:teuthology.orchestra.run.smithi012:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-08-23T00:58:56.001 INFO:tasks.workunit:Running workunits matching rbd/cli_generic.sh on client.0... 2023-08-23T00:58:56.039 INFO:tasks.workunit:Running workunit rbd/cli_generic.sh... 2023-08-23T00:58:56.039 DEBUG:teuthology.orchestra.run.smithi012:workunit test rbd/cli_generic.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=21b2d401852937440c3da8ce2b19224181760caa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2023-08-23T00:58:56.055 INFO:tasks.workunit.client.0.smithi012.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh 2023-08-23T00:58:56.056 INFO:tasks.workunit.client.0.smithi012.stderr:+ . /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/../../standalone/ceph-helpers.sh 2023-08-23T00:58:56.057 INFO:tasks.workunit.client.0.smithi012.stderr:++ TIMEOUT=300 2023-08-23T00:58:56.057 INFO:tasks.workunit.client.0.smithi012.stderr:++ WAIT_FOR_CLEAN_TIMEOUT=90 2023-08-23T00:58:56.058 INFO:tasks.workunit.client.0.smithi012.stderr:++ MAX_TIMEOUT=15 2023-08-23T00:58:56.058 INFO:tasks.workunit.client.0.smithi012.stderr:++ PG_NUM=4 2023-08-23T00:58:56.058 INFO:tasks.workunit.client.0.smithi012.stderr:++ TMPDIR=/tmp 2023-08-23T00:58:56.058 INFO:tasks.workunit.client.0.smithi012.stderr:++ CEPH_BUILD_VIRTUALENV=/tmp 2023-08-23T00:58:56.059 INFO:tasks.workunit.client.0.smithi012.stderr:++ TESTDIR=/home/ubuntu/cephtest 2023-08-23T00:58:56.059 INFO:tasks.workunit.client.0.smithi012.stderr:++ type xmlstarlet 2023-08-23T00:58:56.059 INFO:tasks.workunit.client.0.smithi012.stderr:++ XMLSTARLET=xmlstarlet 2023-08-23T00:58:56.060 INFO:tasks.workunit.client.0.smithi012.stderr:+++ uname 2023-08-23T00:58:56.060 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' Linux = FreeBSD ']' 2023-08-23T00:58:56.060 INFO:tasks.workunit.client.0.smithi012.stderr:++ SED=sed 2023-08-23T00:58:56.060 INFO:tasks.workunit.client.0.smithi012.stderr:++ AWK=awk 2023-08-23T00:58:56.060 INFO:tasks.workunit.client.0.smithi012.stderr:+++ stty -a 2023-08-23T00:58:56.060 INFO:tasks.workunit.client.0.smithi012.stderr:+++ head -1 2023-08-23T00:58:56.061 INFO:tasks.workunit.client.0.smithi012.stderr:+++ sed -e 's/.*columns \([0-9]*\).*/\1/' 2023-08-23T00:58:56.084 INFO:tasks.workunit.client.0.smithi012.stderr:stty: 'standard input': Inappropriate ioctl for device 2023-08-23T00:58:56.085 INFO:tasks.workunit.client.0.smithi012.stderr:++ termwidth= 2023-08-23T00:58:56.085 INFO:tasks.workunit.client.0.smithi012.stderr:++ '[' -n '' -a '' '!=' 0 ']' 2023-08-23T00:58:56.085 INFO:tasks.workunit.client.0.smithi012.stderr:++ DIFFCOLOPTS='-y ' 2023-08-23T00:58:56.085 INFO:tasks.workunit.client.0.smithi012.stderr:++ KERNCORE=kernel.core_pattern 2023-08-23T00:58:56.085 INFO:tasks.workunit.client.0.smithi012.stderr:++ EXTRA_OPTS= 2023-08-23T00:58:56.098 INFO:tasks.workunit.client.0.smithi012.stderr:++ test '' = TESTS 2023-08-23T00:58:56.098 INFO:tasks.workunit.client.0.smithi012.stderr:+ export RBD_FORCE_ALLOW_V1=1 2023-08-23T00:58:56.099 INFO:tasks.workunit.client.0.smithi012.stderr:+ RBD_FORCE_ALLOW_V1=1 2023-08-23T00:58:56.099 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:58:56.100 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T00:58:56.100 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -v '^0$' 2023-08-23T00:58:56.151 INFO:tasks.workunit.client.0.smithi012.stderr:+ IMGS='testimg1 testimg2 testimg3 testimg4 testimg5 testimg6 testimg-diff1 testimg-diff2 testimg-diff3 foo foo2 bar bar2 test1 test2 test3 test4 clone2' 2023-08-23T00:58:56.152 INFO:tasks.workunit.client.0.smithi012.stderr:+ tiered=0 2023-08-23T00:58:56.152 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph osd dump 2023-08-23T00:58:56.153 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^pool' 2023-08-23T00:58:56.153 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep ''\''rbd'\''' 2023-08-23T00:58:56.154 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep tier 2023-08-23T00:58:56.521 INFO:tasks.workunit.client.0.smithi012.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 16 lfor 16/16/16 flags hashpspool tiers 3 read_tier 3 write_tier 3 stripe_width 0 application rbd 2023-08-23T00:58:56.522 INFO:tasks.workunit.client.0.smithi012.stderr:+ tiered=1 2023-08-23T00:58:56.536 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_pool_image_args 2023-08-23T00:58:56.537 INFO:tasks.workunit.client.0.smithi012.stdout:testing pool and image args... 2023-08-23T00:58:56.538 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing pool and image args...' 2023-08-23T00:58:56.538 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T00:58:56.538 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:56.651 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:56.753 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:56.879 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:56.995 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:57.114 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:57.232 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:57.347 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:57.464 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:57.581 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:57.698 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:57.810 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:57.932 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:58.047 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:58.164 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:58.284 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:58.400 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:58.512 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:58:58.631 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2023-08-23T00:58:58.998 INFO:tasks.workunit.client.0.smithi012.stderr:pool 'test' does not exist 2023-08-23T00:58:59.006 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph osd pool create test 32 2023-08-23T00:58:59.965 INFO:tasks.workunit.client.0.smithi012.stderr:pool 'test' already exists 2023-08-23T00:58:59.974 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd pool init test 2023-08-23T00:59:02.902 INFO:tasks.workunit.client.0.smithi012.stderr:+ truncate -s 1 /tmp/empty /tmp/empty@snap 2023-08-23T00:59:02.914 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:02.915 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T00:59:02.915 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 0 2023-08-23T00:59:02.960 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T00:59:02.961 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 1 test1 2023-08-23T00:59:02.996 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:02.992+0000 7ff016e3c340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:04.923 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:04.923 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test1 2023-08-23T00:59:04.961 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd import --image test2 /tmp/empty 2023-08-23T00:59:05.001 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:04.992+0000 7fd96bb0f340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:05.018 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 100% complete...done. 2023-08-23T00:59:05.018 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: --image is deprecated, use --dest 2023-08-23T00:59:05.023 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:05.024 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test2 2023-08-23T00:59:05.063 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd --dest test3 import /tmp/empty 2023-08-23T00:59:05.102 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:05.100+0000 7feceda68340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:05.122 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 100% complete...done. 2023-08-23T00:59:05.127 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:05.127 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test3 2023-08-23T00:59:05.170 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd import /tmp/empty foo 2023-08-23T00:59:05.209 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:05.204+0000 7f32c3ef1340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:05.229 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 100% complete...done. 2023-08-23T00:59:05.235 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:05.236 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q foo 2023-08-23T00:59:05.483 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd import --dest test/empty@snap /tmp/empty 2023-08-23T00:59:05.511 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-08-23T00:59:05.512 INFO:tasks.workunit.client.0.smithi012.stderr:+ true 2023-08-23T00:59:05.513 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd import /tmp/empty test/empty@snap 2023-08-23T00:59:05.538 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-08-23T00:59:05.540 INFO:tasks.workunit.client.0.smithi012.stderr:+ true 2023-08-23T00:59:05.540 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd import --image test/empty@snap /tmp/empty 2023-08-23T00:59:05.567 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-08-23T00:59:05.568 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: --image is deprecated, use --dest 2023-08-23T00:59:05.568 INFO:tasks.workunit.client.0.smithi012.stderr:+ true 2023-08-23T00:59:05.568 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd import /tmp/empty@snap 2023-08-23T00:59:05.590 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: destination snapshot name specified for a command that doesn't use it 2023-08-23T00:59:05.591 INFO:tasks.workunit.client.0.smithi012.stderr:+ true 2023-08-23T00:59:05.592 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:05.592 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T00:59:05.593 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 0 2023-08-23T00:59:05.630 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T00:59:05.630 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd import /tmp/empty test/test1 2023-08-23T00:59:05.669 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:05.664+0000 7fe377b57340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:06.869 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 100% complete...done. 2023-08-23T00:59:06.874 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:06.874 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test1 2023-08-23T00:59:06.914 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd -p test import /tmp/empty test2 2023-08-23T00:59:06.954 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:06.952+0000 7f449fbf7340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:06.976 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 100% complete...done. 2023-08-23T00:59:06.977 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-08-23T00:59:06.982 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:06.983 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test2 2023-08-23T00:59:07.026 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd --image test3 -p test import /tmp/empty 2023-08-23T00:59:07.067 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:07.064+0000 7f28d35d7340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:07.091 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 100% complete...done. 2023-08-23T00:59:07.092 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: --image is deprecated, use --dest 2023-08-23T00:59:07.092 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-08-23T00:59:07.096 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:07.097 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test3 2023-08-23T00:59:07.343 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd --image test4 -p test import /tmp/empty 2023-08-23T00:59:07.385 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:07.380+0000 7f06a696c340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:07.404 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 100% complete...done. 2023-08-23T00:59:07.404 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: --image is deprecated, use --dest 2023-08-23T00:59:07.405 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-08-23T00:59:07.409 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:07.409 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test4 2023-08-23T00:59:07.451 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd --dest test5 -p test import /tmp/empty 2023-08-23T00:59:07.492 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:07.488+0000 7f46621d0340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:07.513 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 100% complete...done. 2023-08-23T00:59:07.514 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-08-23T00:59:07.520 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:07.520 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test5 2023-08-23T00:59:07.558 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd --dest test6 --dest-pool test import /tmp/empty 2023-08-23T00:59:07.598 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:07.596+0000 7f2bc7c5e340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:07.618 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 100% complete...done. 2023-08-23T00:59:07.623 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:07.623 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test6 2023-08-23T00:59:07.663 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd --image test7 --dest-pool test import /tmp/empty 2023-08-23T00:59:07.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:07.696+0000 7f515ae92340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:07.721 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 100% complete...done. 2023-08-23T00:59:07.722 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: --image is deprecated, use --dest 2023-08-23T00:59:07.728 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:07.728 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test7 2023-08-23T00:59:07.769 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd --image test/test8 import /tmp/empty 2023-08-23T00:59:07.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:07.808+0000 7f93b1665340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:07.828 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 100% complete...done. 2023-08-23T00:59:07.829 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: --image is deprecated, use --dest 2023-08-23T00:59:07.834 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:07.834 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test8 2023-08-23T00:59:07.876 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd --dest test/test9 import /tmp/empty 2023-08-23T00:59:07.915 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:07.912+0000 7ffa08020340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:07.935 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 100% complete...done. 2023-08-23T00:59:07.941 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:07.941 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test9 2023-08-23T00:59:07.985 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd import --pool test /tmp/empty 2023-08-23T00:59:08.024 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:08.020+0000 7f7f68d6e340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:08.045 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 100% complete...done. 2023-08-23T00:59:08.046 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: -p [ --pool ] is deprecated, use --dest-pool 2023-08-23T00:59:08.051 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:08.052 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q empty 2023-08-23T00:59:08.095 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd copy test/test9 test10 2023-08-23T00:59:09.881 INFO:tasks.workunit.client.0.smithi012.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-08-23T00:59:09.887 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:09.888 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -qv test10 2023-08-23T00:59:09.930 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:09.930 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test10 2023-08-23T00:59:09.967 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd copy test/test9 test/test10 2023-08-23T00:59:10.053 INFO:tasks.workunit.client.0.smithi012.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-08-23T00:59:10.059 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:10.060 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test10 2023-08-23T00:59:10.104 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd copy --pool test test10 --dest-pool test test11 2023-08-23T00:59:10.194 INFO:tasks.workunit.client.0.smithi012.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-08-23T00:59:10.200 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:10.201 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -q test11 2023-08-23T00:59:10.240 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd copy --dest-pool rbd --pool test test11 test12 2023-08-23T00:59:10.330 INFO:tasks.workunit.client.0.smithi012.stderr: Image copy: 100% complete... Image copy: 100% complete...done. 2023-08-23T00:59:10.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:10.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test12 2023-08-23T00:59:10.380 INFO:tasks.workunit.client.0.smithi012.stdout:test12 2023-08-23T00:59:10.381 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls test 2023-08-23T00:59:10.381 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -qv test12 2023-08-23T00:59:10.422 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm -f /tmp/empty /tmp/empty@snap 2023-08-23T00:59:10.423 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph osd pool delete test test --yes-i-really-really-mean-it 2023-08-23T00:59:10.958 INFO:tasks.workunit.client.0.smithi012.stderr:pool 'test' does not exist 2023-08-23T00:59:10.967 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-08-23T00:59:10.967 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm foo 2023-08-23T00:59:11.041 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:11.044 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-08-23T00:59:11.045 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T00:59:11.099 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:11.104 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-08-23T00:59:11.104 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test10 2023-08-23T00:59:11.238 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:11.243 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-08-23T00:59:11.243 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test12 2023-08-23T00:59:11.377 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:11.382 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-08-23T00:59:11.383 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T00:59:11.444 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:11.450 INFO:tasks.workunit.client.0.smithi012.stderr:+ for f in foo test1 test10 test12 test2 test3 2023-08-23T00:59:11.450 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test3 2023-08-23T00:59:11.509 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:11.513 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_rename 2023-08-23T00:59:11.514 INFO:tasks.workunit.client.0.smithi012.stdout:testing rename... 2023-08-23T00:59:11.515 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing rename...' 2023-08-23T00:59:11.515 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T00:59:11.515 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:11.628 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:11.744 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:11.864 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:11.982 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:12.093 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:12.209 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:12.325 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:12.443 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:12.562 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:12.677 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:12.795 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:12.913 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:13.033 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:13.145 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:13.255 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:13.366 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:13.474 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:13.592 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 1 -s 1 foo 2023-08-23T00:59:13.625 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: image format 1 is deprecated 2023-08-23T00:59:13.637 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:13.632+0000 7f81bc1ee340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:13.650 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 -s 1 bar 2023-08-23T00:59:13.717 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rename foo foo2 2023-08-23T00:59:13.787 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rename foo2 bar 2023-08-23T00:59:13.787 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep exists 2023-08-23T00:59:13.846 INFO:tasks.workunit.client.0.smithi012.stdout:2023-08-23T00:59:13.832+0000 7fba8d504340 -1 librbd::Operations: rbd image bar already exists 2023-08-23T00:59:13.846 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: rename error: (17) File exists 2023-08-23T00:59:13.846 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rename bar bar2 2023-08-23T00:59:13.931 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rename bar2 foo2 2023-08-23T00:59:13.932 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep exists 2023-08-23T00:59:13.992 INFO:tasks.workunit.client.0.smithi012.stdout:2023-08-23T00:59:13.980+0000 7fdc73deb340 -1 librbd::Operations: rbd image foo2 already exists 2023-08-23T00:59:13.993 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: rename error: (17) File exists 2023-08-23T00:59:13.993 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph osd pool create rbd2 8 2023-08-23T00:59:14.969 INFO:tasks.workunit.client.0.smithi012.stderr:pool 'rbd2' already exists 2023-08-23T00:59:14.984 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd pool init rbd2 2023-08-23T00:59:17.853 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -p rbd2 -s 1 foo 2023-08-23T00:59:17.889 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:17.884+0000 7fa839647340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:19.875 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rename rbd2/foo rbd2/bar 2023-08-23T00:59:19.945 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd -p rbd2 ls 2023-08-23T00:59:19.945 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep bar 2023-08-23T00:59:19.987 INFO:tasks.workunit.client.0.smithi012.stdout:bar 2023-08-23T00:59:19.987 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rename rbd2/bar foo 2023-08-23T00:59:20.058 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rename --pool rbd2 foo bar 2023-08-23T00:59:20.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rename rbd2/bar --dest-pool rbd foo 2023-08-23T00:59:20.164 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: mv/rename across pools not supported 2023-08-23T00:59:20.164 INFO:tasks.workunit.client.0.smithi012.stderr:source pool: rbd2 dest pool: rbd 2023-08-23T00:59:20.165 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rename --pool rbd2 bar --dest-pool rbd2 foo 2023-08-23T00:59:20.235 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd -p rbd2 ls 2023-08-23T00:59:20.235 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep foo 2023-08-23T00:59:20.276 INFO:tasks.workunit.client.0.smithi012.stdout:foo 2023-08-23T00:59:20.277 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-08-23T00:59:20.980 INFO:tasks.workunit.client.0.smithi012.stderr:pool 'rbd2' does not exist 2023-08-23T00:59:20.989 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T00:59:20.989 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:21.102 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:21.210 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:21.323 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:21.439 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:21.557 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:21.670 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:21.785 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:21.903 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:22.018 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:22.139 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:22.262 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:22.374 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:22.612 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:22.725 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:22.837 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:22.947 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:23.064 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:23.184 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_ls 2023-08-23T00:59:23.184 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing ls...' 2023-08-23T00:59:23.185 INFO:tasks.workunit.client.0.smithi012.stdout:testing ls... 2023-08-23T00:59:23.185 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T00:59:23.185 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:23.299 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:23.412 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:23.524 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:23.643 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:23.763 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:23.877 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:23.988 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:24.111 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:24.222 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:24.342 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:24.459 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:24.572 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:24.687 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:24.804 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:24.921 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:25.040 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:25.162 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:25.274 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 1 -s 1 test1 2023-08-23T00:59:25.303 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: image format 1 is deprecated 2023-08-23T00:59:25.316 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:25.313+0000 7ff23b437340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:25.327 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 1 -s 1 test2 2023-08-23T00:59:25.354 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: image format 1 is deprecated 2023-08-23T00:59:25.367 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:25.365+0000 7f5c78ef0340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:25.377 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:25.378 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T00:59:25.420 INFO:tasks.workunit.client.0.smithi012.stdout:test1 2023-08-23T00:59:25.425 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:25.425 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test2 2023-08-23T00:59:25.461 INFO:tasks.workunit.client.0.smithi012.stdout:test2 2023-08-23T00:59:25.462 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:25.462 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T00:59:25.463 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 2 2023-08-23T00:59:25.503 INFO:tasks.workunit.client.0.smithi012.stdout:2 2023-08-23T00:59:25.503 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls -l 2023-08-23T00:59:25.503 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'test1.*1 MiB.*1' 2023-08-23T00:59:25.556 INFO:tasks.workunit.client.0.smithi012.stdout:test1 1 MiB 1 2023-08-23T00:59:25.556 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls -l 2023-08-23T00:59:25.557 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'test2.*1 MiB.*1' 2023-08-23T00:59:25.611 INFO:tasks.workunit.client.0.smithi012.stdout:test2 1 MiB 1 2023-08-23T00:59:25.611 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T00:59:25.674 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:25.679 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T00:59:25.746 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:25.752 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 -s 1 test1 2023-08-23T00:59:25.820 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 -s 1 test2 2023-08-23T00:59:25.884 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:25.885 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T00:59:25.918 INFO:tasks.workunit.client.0.smithi012.stdout:test1 2023-08-23T00:59:25.919 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test2 2023-08-23T00:59:25.919 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:25.961 INFO:tasks.workunit.client.0.smithi012.stdout:test2 2023-08-23T00:59:25.962 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:25.962 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T00:59:25.962 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 2 2023-08-23T00:59:26.001 INFO:tasks.workunit.client.0.smithi012.stdout:2 2023-08-23T00:59:26.001 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls -l 2023-08-23T00:59:26.002 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'test1.*1 MiB.*2' 2023-08-23T00:59:26.058 INFO:tasks.workunit.client.0.smithi012.stdout:test1 1 MiB 2 2023-08-23T00:59:26.059 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls -l 2023-08-23T00:59:26.059 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'test2.*1 MiB.*2' 2023-08-23T00:59:26.117 INFO:tasks.workunit.client.0.smithi012.stdout:test2 1 MiB 2 2023-08-23T00:59:26.118 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T00:59:26.280 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:26.277+0000 7f7b03398700 0 -- 172.21.15.12:0/3994445630 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f7ae8008780 msgr2=0x7f7ae800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T00:59:26.281 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:26.286 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T00:59:26.468 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:26.473 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 -s 1 test1 2023-08-23T00:59:26.539 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 1 -s 1 test2 2023-08-23T00:59:26.567 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: image format 1 is deprecated 2023-08-23T00:59:26.578 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:26.577+0000 7f0a1c127340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:26.590 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:26.590 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T00:59:26.629 INFO:tasks.workunit.client.0.smithi012.stdout:test1 2023-08-23T00:59:26.630 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:26.630 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test2 2023-08-23T00:59:26.670 INFO:tasks.workunit.client.0.smithi012.stdout:test2 2023-08-23T00:59:26.671 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T00:59:26.671 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 2 2023-08-23T00:59:26.671 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:26.710 INFO:tasks.workunit.client.0.smithi012.stdout:2 2023-08-23T00:59:26.710 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls -l 2023-08-23T00:59:26.711 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'test1.*1 MiB.*2' 2023-08-23T00:59:26.770 INFO:tasks.workunit.client.0.smithi012.stdout:test1 1 MiB 2 2023-08-23T00:59:26.771 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'test2.*1 MiB.*1' 2023-08-23T00:59:26.771 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls -l 2023-08-23T00:59:26.832 INFO:tasks.workunit.client.0.smithi012.stdout:test2 1 MiB 1 2023-08-23T00:59:26.833 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T00:59:26.833 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:26.944 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:27.063 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:27.183 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:27.300 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:27.416 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:27.531 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:27.650 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:27.767 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:27.881 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:27.999 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:28.113 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:28.234 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:28.351 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:28.605 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:28.732 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:28.855 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:28.958 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T00:59:29.078 INFO:tasks.workunit.client.0.smithi012.stderr:++ seq -w 00 99 2023-08-23T00:59:29.230 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.230 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.00 -s 1 2023-08-23T00:59:29.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.273+0000 7fa05ba99340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.287 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.287 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.01 -s 1 2023-08-23T00:59:29.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.325+0000 7ff144f6b340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.337 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.337 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.02 -s 1 2023-08-23T00:59:29.378 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.377+0000 7f7a6c93f340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.388 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.388 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.03 -s 1 2023-08-23T00:59:29.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.425+0000 7f762bb18340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.439 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.439 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.04 -s 1 2023-08-23T00:59:29.478 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.477+0000 7faba09df340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.488 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.488 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.05 -s 1 2023-08-23T00:59:29.524 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.521+0000 7fcc5b992340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.534 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.535 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.06 -s 1 2023-08-23T00:59:29.573 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.569+0000 7f16b7d01340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.583 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.583 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.07 -s 1 2023-08-23T00:59:29.621 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.617+0000 7f8b4f004340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.632 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.632 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.08 -s 1 2023-08-23T00:59:29.671 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.669+0000 7f5ab8c32340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.682 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.682 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.09 -s 1 2023-08-23T00:59:29.720 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.717+0000 7f11bf3c1340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.734 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.734 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.10 -s 1 2023-08-23T00:59:29.773 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.769+0000 7f285ee88340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.784 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.785 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.11 -s 1 2023-08-23T00:59:29.823 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.821+0000 7fc36ca3e340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.836 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.836 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.12 -s 1 2023-08-23T00:59:29.874 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.873+0000 7fb0b3b1f340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.887 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.887 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.13 -s 1 2023-08-23T00:59:29.928 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.925+0000 7ff599d23340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.938 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.938 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.14 -s 1 2023-08-23T00:59:29.974 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:29.973+0000 7f3f04f9e340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:29.989 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:29.990 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.15 -s 1 2023-08-23T00:59:30.032 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.029+0000 7f8cff831340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.043 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.044 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.16 -s 1 2023-08-23T00:59:30.082 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.081+0000 7fe339564340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.094 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.095 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.17 -s 1 2023-08-23T00:59:30.136 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.133+0000 7f62af254340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.148 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.149 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.18 -s 1 2023-08-23T00:59:30.191 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.189+0000 7fbea91a3340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.202 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.203 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.19 -s 1 2023-08-23T00:59:30.243 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.241+0000 7f5f66f14340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.253 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.254 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.20 -s 1 2023-08-23T00:59:30.293 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.289+0000 7f3b7ae07340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.303 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.304 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.21 -s 1 2023-08-23T00:59:30.339 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.337+0000 7ff31f3b5340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.348 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.349 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.22 -s 1 2023-08-23T00:59:30.384 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.381+0000 7f78bd427340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.393 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.394 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.23 -s 1 2023-08-23T00:59:30.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.425+0000 7efdce4a7340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.440 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.440 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.24 -s 1 2023-08-23T00:59:30.479 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.477+0000 7f2d9e35f340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.490 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.490 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.25 -s 1 2023-08-23T00:59:30.529 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.525+0000 7fdcd0b76340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.540 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.541 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.26 -s 1 2023-08-23T00:59:30.783 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.781+0000 7f6f3fa5a340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.795 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.796 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.27 -s 1 2023-08-23T00:59:30.836 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.833+0000 7f74e2d1a340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.846 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.846 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.28 -s 1 2023-08-23T00:59:30.882 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.881+0000 7f64eb5d2340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.893 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.894 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.29 -s 1 2023-08-23T00:59:30.930 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.929+0000 7f1be7feb340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.940 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.941 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.30 -s 1 2023-08-23T00:59:30.978 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:30.977+0000 7f6b7e6b4340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:30.989 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:30.990 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.31 -s 1 2023-08-23T00:59:31.027 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.025+0000 7f692e9c6340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.038 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.038 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.32 -s 1 2023-08-23T00:59:31.074 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.069+0000 7f46db8a7340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.085 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.085 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.33 -s 1 2023-08-23T00:59:31.124 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.121+0000 7fdbab66e340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.136 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.136 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.34 -s 1 2023-08-23T00:59:31.176 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.173+0000 7f6c475d6340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.187 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.187 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.35 -s 1 2023-08-23T00:59:31.227 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.225+0000 7f5c48cbe340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.238 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.238 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.36 -s 1 2023-08-23T00:59:31.277 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.273+0000 7f670fec5340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.288 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.288 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.37 -s 1 2023-08-23T00:59:31.326 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.325+0000 7f3f6aa6a340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.339 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.339 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.38 -s 1 2023-08-23T00:59:31.380 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.377+0000 7f525edeb340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.389 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.390 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.39 -s 1 2023-08-23T00:59:31.429 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.425+0000 7fb53da4c340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.439 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.439 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.40 -s 1 2023-08-23T00:59:31.477 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.473+0000 7ff1fa0a3340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.490 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.490 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.41 -s 1 2023-08-23T00:59:31.529 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.529+0000 7f9b4ce69340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.543 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.543 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.42 -s 1 2023-08-23T00:59:31.579 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.577+0000 7f06f5c44340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.594 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.594 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.43 -s 1 2023-08-23T00:59:31.635 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.633+0000 7fe650ff2340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.649 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.649 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.44 -s 1 2023-08-23T00:59:31.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.689+0000 7f2c97614340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.703 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.704 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.45 -s 1 2023-08-23T00:59:31.744 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.741+0000 7f310c9fe340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.757 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.757 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.46 -s 1 2023-08-23T00:59:31.798 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.797+0000 7f7deb9e5340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.811 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.811 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.47 -s 1 2023-08-23T00:59:31.851 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.849+0000 7f788e9a5340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.862 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.862 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.48 -s 1 2023-08-23T00:59:31.900 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.897+0000 7f82a11d0340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.910 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.911 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.49 -s 1 2023-08-23T00:59:31.947 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.945+0000 7fb9ddc89340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:31.957 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:31.958 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.50 -s 1 2023-08-23T00:59:31.992 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:31.989+0000 7f046d546340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.005 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.006 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.51 -s 1 2023-08-23T00:59:32.043 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.041+0000 7f002ad2e340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.054 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.054 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.52 -s 1 2023-08-23T00:59:32.093 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.089+0000 7f2260e7e340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.104 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.104 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.53 -s 1 2023-08-23T00:59:32.146 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.145+0000 7f39565c1340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.157 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.158 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.54 -s 1 2023-08-23T00:59:32.198 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.197+0000 7f1a3f620340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.209 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.210 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.55 -s 1 2023-08-23T00:59:32.249 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.245+0000 7ff99b8a7340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.259 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.259 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.56 -s 1 2023-08-23T00:59:32.299 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.297+0000 7fcb8d8e7340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.309 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.309 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.57 -s 1 2023-08-23T00:59:32.346 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.345+0000 7f2e862a0340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.357 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.358 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.58 -s 1 2023-08-23T00:59:32.394 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.393+0000 7f57a00ef340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.405 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.405 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.59 -s 1 2023-08-23T00:59:32.443 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.441+0000 7fc8de21c340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.455 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.455 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.60 -s 1 2023-08-23T00:59:32.493 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.489+0000 7f5238fef340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.505 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.506 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.61 -s 1 2023-08-23T00:59:32.543 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.541+0000 7f8771659340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.554 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.554 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.62 -s 1 2023-08-23T00:59:32.589 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.585+0000 7f55425d9340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.606 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.607 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.63 -s 1 2023-08-23T00:59:32.643 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.641+0000 7f0db3ea5340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.654 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.654 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.64 -s 1 2023-08-23T00:59:32.691 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.689+0000 7ffa1583c340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.702 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.702 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.65 -s 1 2023-08-23T00:59:32.743 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.741+0000 7fdf35038340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.755 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.755 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.66 -s 1 2023-08-23T00:59:32.791 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.789+0000 7ffaa68d5340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.806 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.807 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.67 -s 1 2023-08-23T00:59:32.843 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.841+0000 7f1d737e7340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.856 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.856 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.68 -s 1 2023-08-23T00:59:32.892 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.889+0000 7ff5acefd340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.903 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.903 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.69 -s 1 2023-08-23T00:59:32.941 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.937+0000 7fb8bd67a340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:32.951 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:32.952 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.70 -s 1 2023-08-23T00:59:32.992 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:32.989+0000 7f711fd84340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.008 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.008 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.71 -s 1 2023-08-23T00:59:33.048 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.045+0000 7fa1b072d340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.059 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.059 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.72 -s 1 2023-08-23T00:59:33.096 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.093+0000 7f4521ff7340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.106 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.107 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.73 -s 1 2023-08-23T00:59:33.142 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.141+0000 7f6b898d5340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.152 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.153 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.74 -s 1 2023-08-23T00:59:33.187 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.185+0000 7fa4ca08a340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.199 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.199 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.75 -s 1 2023-08-23T00:59:33.237 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.233+0000 7f010dad2340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.249 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.249 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.76 -s 1 2023-08-23T00:59:33.288 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.285+0000 7fb17adc6340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.299 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.300 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.77 -s 1 2023-08-23T00:59:33.341 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.337+0000 7fd48af73340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.358 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.358 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.78 -s 1 2023-08-23T00:59:33.395 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.393+0000 7fef44639340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.407 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.408 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.79 -s 1 2023-08-23T00:59:33.445 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.445+0000 7f9d82af7340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.458 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.459 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.80 -s 1 2023-08-23T00:59:33.501 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.497+0000 7fb31c319340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.516 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.516 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.81 -s 1 2023-08-23T00:59:33.553 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.549+0000 7f91200e5340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.566 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.566 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.82 -s 1 2023-08-23T00:59:33.603 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.601+0000 7f0a43e65340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.616 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.616 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.83 -s 1 2023-08-23T00:59:33.655 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.653+0000 7fb9c3a78340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.665 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.665 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.84 -s 1 2023-08-23T00:59:33.702 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.701+0000 7f9779cc1340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.712 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.712 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.85 -s 1 2023-08-23T00:59:33.754 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.753+0000 7f2b51d48340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.772 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.772 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.86 -s 1 2023-08-23T00:59:33.810 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.809+0000 7f6e76454340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.821 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.822 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.87 -s 1 2023-08-23T00:59:33.856 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.853+0000 7f64939ae340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.867 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.867 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.88 -s 1 2023-08-23T00:59:33.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.905+0000 7fe110e11340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.916 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.916 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.89 -s 1 2023-08-23T00:59:33.956 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:33.953+0000 7fb128bd3340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:33.969 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:33.969 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.90 -s 1 2023-08-23T00:59:34.007 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:34.005+0000 7fee6e3cd340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:34.022 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:34.022 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.91 -s 1 2023-08-23T00:59:34.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:34.061+0000 7fd92d089340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:34.074 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:34.075 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.92 -s 1 2023-08-23T00:59:34.117 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:34.113+0000 7f691ed8a340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:34.133 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:34.133 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.93 -s 1 2023-08-23T00:59:34.172 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:34.169+0000 7f86a54ec340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:34.184 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:34.184 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.94 -s 1 2023-08-23T00:59:34.219 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:34.217+0000 7fd645418340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:34.231 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:34.232 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.95 -s 1 2023-08-23T00:59:34.274 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:34.273+0000 7f1bf134d340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:34.288 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:34.288 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.96 -s 1 2023-08-23T00:59:34.322 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:34.321+0000 7f975716e340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:34.334 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:34.334 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.97 -s 1 2023-08-23T00:59:34.376 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:34.373+0000 7f3accefc340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:34.388 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:34.388 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.98 -s 1 2023-08-23T00:59:34.428 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:34.425+0000 7f5d6615e340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:34.446 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:34.446 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.99 -s 1 2023-08-23T00:59:34.491 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:34.489+0000 7fb0def89340 -1 librbd: Forced V1 image creation. 2023-08-23T00:59:34.503 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:34.504 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T00:59:34.504 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 100 2023-08-23T00:59:34.543 INFO:tasks.workunit.client.0.smithi012.stdout:100 2023-08-23T00:59:34.543 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls -l 2023-08-23T00:59:34.544 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep image 2023-08-23T00:59:34.544 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T00:59:34.544 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 100 2023-08-23T00:59:34.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:34.637+0000 7f17d668d700 0 -- 172.21.15.12:0/621651284 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x55e101dd0b10 msgr2=0x55e101dd0f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T00:59:34.653 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:34.649+0000 7f17d668d700 0 -- 172.21.15.12:0/621651284 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f17b8033b00 msgr2=0x7f17b8035f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T00:59:34.861 INFO:tasks.workunit.client.0.smithi012.stdout:100 2023-08-23T00:59:34.862 INFO:tasks.workunit.client.0.smithi012.stderr:++ seq -w 00 99 2023-08-23T00:59:34.863 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:34.863 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.00 2023-08-23T00:59:34.923 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:34.927 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:34.927 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.01 2023-08-23T00:59:34.990 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:34.994 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:34.994 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.02 2023-08-23T00:59:35.055 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:35.061 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:35.061 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.03 2023-08-23T00:59:35.125 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:35.130 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:35.130 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.04 2023-08-23T00:59:35.197 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:35.203 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:35.203 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.05 2023-08-23T00:59:35.264 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:35.268 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:35.269 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.06 2023-08-23T00:59:35.332 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:35.337 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:35.338 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.07 2023-08-23T00:59:35.396 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:35.401 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:35.401 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.08 2023-08-23T00:59:35.466 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:35.471 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:35.471 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.09 2023-08-23T00:59:35.540 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:35.545 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:35.545 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.10 2023-08-23T00:59:35.607 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:35.612 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:35.613 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.11 2023-08-23T00:59:35.672 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:35.678 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:35.678 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.12 2023-08-23T00:59:35.741 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:35.746 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:35.747 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.13 2023-08-23T00:59:35.811 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:35.815 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:35.816 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.14 2023-08-23T00:59:35.880 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:35.885 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:35.885 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.15 2023-08-23T00:59:35.948 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:35.952 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:35.953 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.16 2023-08-23T00:59:36.014 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.018 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.018 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.17 2023-08-23T00:59:36.080 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.085 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.085 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.18 2023-08-23T00:59:36.155 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.160 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.160 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.19 2023-08-23T00:59:36.219 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.224 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.224 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.20 2023-08-23T00:59:36.281 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.286 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.286 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.21 2023-08-23T00:59:36.346 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.351 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.352 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.22 2023-08-23T00:59:36.421 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.427 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.428 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.23 2023-08-23T00:59:36.486 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.490 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.491 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.24 2023-08-23T00:59:36.553 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.558 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.558 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.25 2023-08-23T00:59:36.624 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.630 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.630 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.26 2023-08-23T00:59:36.691 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.697 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.697 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.27 2023-08-23T00:59:36.763 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.768 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.768 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.28 2023-08-23T00:59:36.835 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.840 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.29 2023-08-23T00:59:36.902 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.907 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.907 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.30 2023-08-23T00:59:36.969 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:36.974 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:36.974 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.31 2023-08-23T00:59:37.037 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.041 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.042 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.32 2023-08-23T00:59:37.105 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.109 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.110 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.33 2023-08-23T00:59:37.174 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.180 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.180 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.34 2023-08-23T00:59:37.246 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.251 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.251 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.35 2023-08-23T00:59:37.311 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.315 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.316 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.36 2023-08-23T00:59:37.380 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.385 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.385 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.37 2023-08-23T00:59:37.446 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.451 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.451 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.38 2023-08-23T00:59:37.506 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.510 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.510 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.39 2023-08-23T00:59:37.577 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.582 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.582 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.40 2023-08-23T00:59:37.644 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.648 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.648 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.41 2023-08-23T00:59:37.711 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.716 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.717 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.42 2023-08-23T00:59:37.781 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.786 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.786 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.43 2023-08-23T00:59:37.847 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.851 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.852 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.44 2023-08-23T00:59:37.910 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.915 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.915 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.45 2023-08-23T00:59:37.975 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:37.981 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:37.981 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.46 2023-08-23T00:59:38.048 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:38.052 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:38.053 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.47 2023-08-23T00:59:38.119 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:38.125 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:38.125 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.48 2023-08-23T00:59:38.190 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:38.195 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:38.195 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.49 2023-08-23T00:59:38.256 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:38.261 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:38.261 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.50 2023-08-23T00:59:38.328 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:38.332 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:38.333 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.51 2023-08-23T00:59:38.396 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:38.401 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:38.401 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.52 2023-08-23T00:59:38.465 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:38.469 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:38.470 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.53 2023-08-23T00:59:38.528 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:38.533 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:38.533 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.54 2023-08-23T00:59:38.592 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:38.597 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:38.597 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.55 2023-08-23T00:59:38.660 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:38.664 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:38.664 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.56 2023-08-23T00:59:38.726 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:38.731 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:38.732 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.57 2023-08-23T00:59:38.797 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:38.802 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:38.803 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.58 2023-08-23T00:59:38.866 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:38.871 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:38.872 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.59 2023-08-23T00:59:38.934 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:38.938 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:38.939 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.60 2023-08-23T00:59:39.004 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.008 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.009 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.61 2023-08-23T00:59:39.070 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.074 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.075 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.62 2023-08-23T00:59:39.134 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.139 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.139 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.63 2023-08-23T00:59:39.205 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.209 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.209 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.64 2023-08-23T00:59:39.272 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.277 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.277 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.65 2023-08-23T00:59:39.346 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.351 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.351 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.66 2023-08-23T00:59:39.414 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.419 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.420 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.67 2023-08-23T00:59:39.494 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.498 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.498 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.68 2023-08-23T00:59:39.557 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.562 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.562 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.69 2023-08-23T00:59:39.624 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.629 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.629 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.70 2023-08-23T00:59:39.691 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.695 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.696 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.71 2023-08-23T00:59:39.759 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.764 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.765 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.72 2023-08-23T00:59:39.826 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.831 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.831 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.73 2023-08-23T00:59:39.899 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.903 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.904 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.74 2023-08-23T00:59:39.965 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:39.969 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:39.969 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.75 2023-08-23T00:59:40.030 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.034 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.035 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.76 2023-08-23T00:59:40.093 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.097 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.097 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.77 2023-08-23T00:59:40.163 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.169 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.169 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.78 2023-08-23T00:59:40.227 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.231 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.231 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.79 2023-08-23T00:59:40.294 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.299 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.299 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.80 2023-08-23T00:59:40.361 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.366 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.366 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.81 2023-08-23T00:59:40.435 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.439 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.439 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.82 2023-08-23T00:59:40.506 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.510 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.510 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.83 2023-08-23T00:59:40.570 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.575 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.575 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.84 2023-08-23T00:59:40.634 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.639 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.640 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.85 2023-08-23T00:59:40.702 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.706 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.707 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.86 2023-08-23T00:59:40.768 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.774 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.775 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.87 2023-08-23T00:59:40.841 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.845 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.845 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.88 2023-08-23T00:59:40.906 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.911 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.911 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.89 2023-08-23T00:59:40.973 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:40.978 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:40.978 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.90 2023-08-23T00:59:41.041 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:41.045 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.045 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.91 2023-08-23T00:59:41.100 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:41.103 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.104 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.92 2023-08-23T00:59:41.166 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:41.172 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.172 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.93 2023-08-23T00:59:41.232 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:41.237 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.238 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.94 2023-08-23T00:59:41.300 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:41.304 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.304 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.95 2023-08-23T00:59:41.369 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:41.373 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.373 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.96 2023-08-23T00:59:41.437 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:41.441 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.441 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.97 2023-08-23T00:59:41.503 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:41.507 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.507 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.98 2023-08-23T00:59:41.568 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:41.572 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.572 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.99 2023-08-23T00:59:41.637 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:41.642 INFO:tasks.workunit.client.0.smithi012.stderr:++ seq -w 00 99 2023-08-23T00:59:41.643 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.643 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.00 --image-format 2 -s 1 2023-08-23T00:59:41.707 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.708 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.01 --image-format 2 -s 1 2023-08-23T00:59:41.773 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.774 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.02 --image-format 2 -s 1 2023-08-23T00:59:41.849 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.849 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.03 --image-format 2 -s 1 2023-08-23T00:59:41.908 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.909 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.04 --image-format 2 -s 1 2023-08-23T00:59:41.978 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:41.978 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.05 --image-format 2 -s 1 2023-08-23T00:59:42.038 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.038 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.06 --image-format 2 -s 1 2023-08-23T00:59:42.096 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.096 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.07 --image-format 2 -s 1 2023-08-23T00:59:42.162 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.162 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.08 --image-format 2 -s 1 2023-08-23T00:59:42.227 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.227 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.09 --image-format 2 -s 1 2023-08-23T00:59:42.294 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.294 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.10 --image-format 2 -s 1 2023-08-23T00:59:42.358 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.358 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.11 --image-format 2 -s 1 2023-08-23T00:59:42.418 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.419 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.12 --image-format 2 -s 1 2023-08-23T00:59:42.488 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.488 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.13 --image-format 2 -s 1 2023-08-23T00:59:42.553 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.554 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.14 --image-format 2 -s 1 2023-08-23T00:59:42.618 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.618 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.15 --image-format 2 -s 1 2023-08-23T00:59:42.681 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.681 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.16 --image-format 2 -s 1 2023-08-23T00:59:42.740 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.741 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.17 --image-format 2 -s 1 2023-08-23T00:59:42.811 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.811 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.18 --image-format 2 -s 1 2023-08-23T00:59:42.880 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.880 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.19 --image-format 2 -s 1 2023-08-23T00:59:42.949 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:42.949 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.20 --image-format 2 -s 1 2023-08-23T00:59:43.015 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.015 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.21 --image-format 2 -s 1 2023-08-23T00:59:43.077 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.077 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.22 --image-format 2 -s 1 2023-08-23T00:59:43.143 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.144 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.23 --image-format 2 -s 1 2023-08-23T00:59:43.211 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.212 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.24 --image-format 2 -s 1 2023-08-23T00:59:43.269 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.270 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.25 --image-format 2 -s 1 2023-08-23T00:59:43.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.26 --image-format 2 -s 1 2023-08-23T00:59:43.397 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.398 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.27 --image-format 2 -s 1 2023-08-23T00:59:43.461 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.461 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.28 --image-format 2 -s 1 2023-08-23T00:59:43.527 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.528 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.29 --image-format 2 -s 1 2023-08-23T00:59:43.589 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.589 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.30 --image-format 2 -s 1 2023-08-23T00:59:43.651 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.652 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.31 --image-format 2 -s 1 2023-08-23T00:59:43.721 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.722 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.32 --image-format 2 -s 1 2023-08-23T00:59:43.786 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.786 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.33 --image-format 2 -s 1 2023-08-23T00:59:43.849 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.850 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.34 --image-format 2 -s 1 2023-08-23T00:59:43.910 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.911 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.35 --image-format 2 -s 1 2023-08-23T00:59:43.981 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:43.981 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.36 --image-format 2 -s 1 2023-08-23T00:59:44.046 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.046 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.37 --image-format 2 -s 1 2023-08-23T00:59:44.111 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.111 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.38 --image-format 2 -s 1 2023-08-23T00:59:44.171 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.172 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.39 --image-format 2 -s 1 2023-08-23T00:59:44.231 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.231 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.40 --image-format 2 -s 1 2023-08-23T00:59:44.299 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.299 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.41 --image-format 2 -s 1 2023-08-23T00:59:44.360 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.360 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.42 --image-format 2 -s 1 2023-08-23T00:59:44.433 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.433 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.43 --image-format 2 -s 1 2023-08-23T00:59:44.500 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.501 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.44 --image-format 2 -s 1 2023-08-23T00:59:44.561 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.562 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.45 --image-format 2 -s 1 2023-08-23T00:59:44.627 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.627 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.46 --image-format 2 -s 1 2023-08-23T00:59:44.688 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.688 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.47 --image-format 2 -s 1 2023-08-23T00:59:44.755 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.756 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.48 --image-format 2 -s 1 2023-08-23T00:59:44.818 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.818 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.49 --image-format 2 -s 1 2023-08-23T00:59:44.881 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.882 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.50 --image-format 2 -s 1 2023-08-23T00:59:44.949 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:44.949 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.51 --image-format 2 -s 1 2023-08-23T00:59:45.014 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.014 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.52 --image-format 2 -s 1 2023-08-23T00:59:45.079 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.080 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.53 --image-format 2 -s 1 2023-08-23T00:59:45.143 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.143 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.54 --image-format 2 -s 1 2023-08-23T00:59:45.203 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.204 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.55 --image-format 2 -s 1 2023-08-23T00:59:45.264 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.265 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.56 --image-format 2 -s 1 2023-08-23T00:59:45.330 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.330 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.57 --image-format 2 -s 1 2023-08-23T00:59:45.388 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.389 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.58 --image-format 2 -s 1 2023-08-23T00:59:45.450 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.450 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.59 --image-format 2 -s 1 2023-08-23T00:59:45.520 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.520 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.60 --image-format 2 -s 1 2023-08-23T00:59:45.585 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.585 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.61 --image-format 2 -s 1 2023-08-23T00:59:45.651 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.651 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.62 --image-format 2 -s 1 2023-08-23T00:59:45.712 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.712 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.63 --image-format 2 -s 1 2023-08-23T00:59:45.776 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.777 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.64 --image-format 2 -s 1 2023-08-23T00:59:45.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.65 --image-format 2 -s 1 2023-08-23T00:59:45.901 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.902 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.66 --image-format 2 -s 1 2023-08-23T00:59:45.963 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:45.963 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.67 --image-format 2 -s 1 2023-08-23T00:59:46.027 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.027 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.68 --image-format 2 -s 1 2023-08-23T00:59:46.085 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.085 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.69 --image-format 2 -s 1 2023-08-23T00:59:46.153 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.153 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.70 --image-format 2 -s 1 2023-08-23T00:59:46.216 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.217 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.71 --image-format 2 -s 1 2023-08-23T00:59:46.276 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.277 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.72 --image-format 2 -s 1 2023-08-23T00:59:46.345 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.346 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.73 --image-format 2 -s 1 2023-08-23T00:59:46.417 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.417 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.74 --image-format 2 -s 1 2023-08-23T00:59:46.479 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.479 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.75 --image-format 2 -s 1 2023-08-23T00:59:46.544 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.544 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.76 --image-format 2 -s 1 2023-08-23T00:59:46.606 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.606 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.77 --image-format 2 -s 1 2023-08-23T00:59:46.667 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.667 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.78 --image-format 2 -s 1 2023-08-23T00:59:46.728 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.729 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.79 --image-format 2 -s 1 2023-08-23T00:59:46.789 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.790 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.80 --image-format 2 -s 1 2023-08-23T00:59:46.855 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.855 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.81 --image-format 2 -s 1 2023-08-23T00:59:46.917 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.917 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.82 --image-format 2 -s 1 2023-08-23T00:59:46.985 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:46.986 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.83 --image-format 2 -s 1 2023-08-23T00:59:47.048 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.048 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.84 --image-format 2 -s 1 2023-08-23T00:59:47.113 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.113 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.85 --image-format 2 -s 1 2023-08-23T00:59:47.178 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.178 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.86 --image-format 2 -s 1 2023-08-23T00:59:47.238 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.239 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.87 --image-format 2 -s 1 2023-08-23T00:59:47.304 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.304 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.88 --image-format 2 -s 1 2023-08-23T00:59:47.370 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.371 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.89 --image-format 2 -s 1 2023-08-23T00:59:47.432 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.432 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.90 --image-format 2 -s 1 2023-08-23T00:59:47.493 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.494 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.91 --image-format 2 -s 1 2023-08-23T00:59:47.566 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.567 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.92 --image-format 2 -s 1 2023-08-23T00:59:47.628 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.629 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.93 --image-format 2 -s 1 2023-08-23T00:59:47.690 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.690 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.94 --image-format 2 -s 1 2023-08-23T00:59:47.751 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.751 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.95 --image-format 2 -s 1 2023-08-23T00:59:47.815 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.816 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.96 --image-format 2 -s 1 2023-08-23T00:59:47.881 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.881 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.97 --image-format 2 -s 1 2023-08-23T00:59:47.954 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:47.954 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.98 --image-format 2 -s 1 2023-08-23T00:59:48.023 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:48.024 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create image.99 --image-format 2 -s 1 2023-08-23T00:59:48.086 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T00:59:48.087 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T00:59:48.087 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 100 2023-08-23T00:59:48.130 INFO:tasks.workunit.client.0.smithi012.stdout:100 2023-08-23T00:59:48.130 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep image 2023-08-23T00:59:48.131 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T00:59:48.131 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 100 2023-08-23T00:59:48.131 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls -l 2023-08-23T00:59:48.222 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:48.221+0000 7fe5c190b700 0 -- 172.21.15.12:0/2321241845 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x55d234d85e40 msgr2=0x55d234d88230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T00:59:48.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:48.233+0000 7fe5c210c700 0 -- 172.21.15.12:0/2321241845 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x55d234cdbdb0 msgr2=0x55d234ccca10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T00:59:48.569 INFO:tasks.workunit.client.0.smithi012.stdout:100 2023-08-23T00:59:48.569 INFO:tasks.workunit.client.0.smithi012.stderr:++ seq -w 00 99 2023-08-23T00:59:48.570 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:48.570 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.00 2023-08-23T00:59:48.743 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:48.748 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:48.749 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.01 2023-08-23T00:59:48.920 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:48.917+0000 7fc2a2c65700 0 -- 172.21.15.12:0/3391886360 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x56520168dc60 msgr2=0x56520173ebc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T00:59:48.923 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:48.928 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:48.928 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.02 2023-08-23T00:59:49.135 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:49.139 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:49.140 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.03 2023-08-23T00:59:49.323 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:49.328 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:49.328 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.04 2023-08-23T00:59:49.521 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:49.517+0000 7faec4ed5700 0 -- 172.21.15.12:0/2792973448 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x55b7c7b0fc50 msgr2=0x55b7c7ac97f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T00:59:49.522 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:49.526 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:49.527 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.05 2023-08-23T00:59:49.710 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:49.715 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:49.716 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.06 2023-08-23T00:59:49.899 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:49.904 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:49.904 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.07 2023-08-23T00:59:50.079 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:50.083 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:50.084 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.08 2023-08-23T00:59:50.276 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:50.280 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:50.280 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.09 2023-08-23T00:59:50.456 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:50.461 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:50.462 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.10 2023-08-23T00:59:50.638 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:50.644 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:50.645 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.11 2023-08-23T00:59:50.836 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:50.840 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:50.840 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.12 2023-08-23T00:59:51.023 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:51.027 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:51.028 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.13 2023-08-23T00:59:51.226 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:51.231 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:51.231 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.14 2023-08-23T00:59:51.419 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:51.422 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:51.423 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.15 2023-08-23T00:59:51.605 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:51.610 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:51.610 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.16 2023-08-23T00:59:51.797 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:51.802 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:51.802 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.17 2023-08-23T00:59:51.990 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:51.995 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:51.996 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.18 2023-08-23T00:59:52.176 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:52.179 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:52.180 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.19 2023-08-23T00:59:52.361 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:52.366 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:52.366 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.20 2023-08-23T00:59:52.557 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:52.563 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:52.637 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.21 2023-08-23T00:59:52.756 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:52.752+0000 7f120c8af700 0 -- 172.21.15.12:0/4042522016 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f11ec033bc0 msgr2=0x7f11ec035ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T00:59:52.758 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:52.763 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:52.763 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.22 2023-08-23T00:59:52.948 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:52.953 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:52.954 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.23 2023-08-23T00:59:53.124 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:53.129 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:53.130 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.24 2023-08-23T00:59:53.355 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:53.360 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:53.360 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.25 2023-08-23T00:59:53.540 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:53.544 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:53.545 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.26 2023-08-23T00:59:53.724 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:53.729 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:53.729 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.27 2023-08-23T00:59:53.920 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:53.923 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:53.924 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.28 2023-08-23T00:59:54.107 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:54.113 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:54.113 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.29 2023-08-23T00:59:54.303 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:54.308 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:54.308 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.30 2023-08-23T00:59:54.516 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:54.521 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:54.521 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.31 2023-08-23T00:59:54.710 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:54.715 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:54.715 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.32 2023-08-23T00:59:54.899 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:54.903 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:54.903 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.33 2023-08-23T00:59:55.079 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:55.084 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:55.084 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.34 2023-08-23T00:59:55.274 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:55.279 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:55.280 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.35 2023-08-23T00:59:55.474 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:55.478 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:55.478 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.36 2023-08-23T00:59:55.664 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:55.669 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:55.670 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.37 2023-08-23T00:59:55.855 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:55.859 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:55.860 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.38 2023-08-23T00:59:56.044 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:56.048 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:56.048 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.39 2023-08-23T00:59:56.232 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:56.237 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:56.237 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.40 2023-08-23T00:59:56.420 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:56.425 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:56.426 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.41 2023-08-23T00:59:56.619 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:56.616+0000 7f14c3352700 0 -- 172.21.15.12:0/3692952916 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f14a8008780 msgr2=0x7f14a800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T00:59:56.619 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:56.623 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:56.624 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.42 2023-08-23T00:59:56.813 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:56.817 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:56.818 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.43 2023-08-23T00:59:57.000 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:57.005 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:57.005 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.44 2023-08-23T00:59:57.196 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:57.201 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:57.202 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.45 2023-08-23T00:59:57.412 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:57.416 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:57.417 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.46 2023-08-23T00:59:57.601 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:57.606 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:57.606 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.47 2023-08-23T00:59:57.801 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:57.806 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:57.807 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.48 2023-08-23T00:59:58.000 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:58.004 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:58.004 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.49 2023-08-23T00:59:58.188 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:58.193 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:58.193 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.50 2023-08-23T00:59:58.373 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:58.378 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:58.378 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.51 2023-08-23T00:59:58.573 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:58.578 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:58.578 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.52 2023-08-23T00:59:58.767 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:58.772 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:58.772 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.53 2023-08-23T00:59:58.957 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:58.961 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:58.962 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.54 2023-08-23T00:59:59.154 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:59.159 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:59.159 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.55 2023-08-23T00:59:59.351 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:59.356 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:59.356 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.56 2023-08-23T00:59:59.545 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:59.550 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:59.550 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.57 2023-08-23T00:59:59.734 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T00:59:59.732+0000 7f4ad53e0700 0 -- 172.21.15.12:0/623058212 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f4ab0008780 msgr2=0x7f4ab000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T00:59:59.734 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:59.740 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:59.740 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.58 2023-08-23T00:59:59.933 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T00:59:59.937 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T00:59:59.937 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.59 2023-08-23T01:00:00.106 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:00.110 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:00.110 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.60 2023-08-23T01:00:00.500 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:00.496+0000 7faa007f9700 0 -- 172.21.15.12:0/3834514679 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x55faf1bbf3d0 msgr2=0x55faf1b97830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:00.500 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:00.505 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:00.505 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.61 2023-08-23T01:00:00.704 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:00.709 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:00.709 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.62 2023-08-23T01:00:00.882 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:00.880+0000 7f99f4fee700 0 -- 172.21.15.12:0/167125617 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x5593021a9060 msgr2=0x559302252070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:00.894 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:00.899 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:00.899 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.63 2023-08-23T01:00:01.092 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:01.097 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:01.097 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.64 2023-08-23T01:00:01.290 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:01.294 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:01.295 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.65 2023-08-23T01:00:01.486 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:01.490 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:01.491 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.66 2023-08-23T01:00:01.678 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:01.683 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:01.683 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.67 2023-08-23T01:00:01.871 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:01.868+0000 7fe28f531700 0 -- 172.21.15.12:0/3969881219 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7fe274008780 msgr2=0x7fe27400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:01.872 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:01.876 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:01.876 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.68 2023-08-23T01:00:02.060 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:02.065 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:02.065 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.69 2023-08-23T01:00:02.253 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:02.258 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:02.258 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.70 2023-08-23T01:00:02.456 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:02.452+0000 7fb746b64700 0 -- 172.21.15.12:0/1246336758 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7fb724008780 msgr2=0x7fb72400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:02.457 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:02.462 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:02.462 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.71 2023-08-23T01:00:02.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:02.636+0000 7f076de97700 0 -- 172.21.15.12:0/962273467 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f074c008780 msgr2=0x7f074c00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:02.641 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:02.645 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:02.646 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.72 2023-08-23T01:00:02.845 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:02.849 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:02.849 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.73 2023-08-23T01:00:03.058 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:03.062 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:03.063 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.74 2023-08-23T01:00:03.240 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:03.245 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:03.245 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.75 2023-08-23T01:00:03.431 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:03.428+0000 7f84bc004700 0 -- 172.21.15.12:0/618535012 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x562ab555bc60 msgr2=0x562ab560cbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:03.435 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:03.441 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:03.441 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.76 2023-08-23T01:00:03.644 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:03.649 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:03.649 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.77 2023-08-23T01:00:03.834 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:03.838 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:03.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.78 2023-08-23T01:00:04.024 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:04.029 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:04.030 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.79 2023-08-23T01:00:04.235 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:04.240 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:04.240 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.80 2023-08-23T01:00:04.421 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:04.426 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:04.426 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.81 2023-08-23T01:00:04.629 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:04.634 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:04.634 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.82 2023-08-23T01:00:04.834 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:04.828+0000 7f9880188700 0 -- 172.21.15.12:0/2861008515 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f985c008780 msgr2=0x7f985c00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:04.834 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:04.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:04.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.83 2023-08-23T01:00:05.051 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:05.055 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:05.056 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.84 2023-08-23T01:00:05.252 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:05.257 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:05.257 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.85 2023-08-23T01:00:05.438 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:05.436+0000 7f0491981700 0 -- 172.21.15.12:0/3404386865 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f0474033bd0 msgr2=0x7f0474036000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:05.451 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:05.456 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:05.456 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.86 2023-08-23T01:00:05.658 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:05.662 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:05.662 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.87 2023-08-23T01:00:05.860 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:05.865 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:05.865 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.88 2023-08-23T01:00:06.072 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:06.077 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:06.078 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.89 2023-08-23T01:00:06.271 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:06.276 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:06.276 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.90 2023-08-23T01:00:06.473 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:06.468+0000 7fa361cf5700 0 -- 172.21.15.12:0/3427504114 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7fa344033bd0 msgr2=0x7fa344036000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:06.477 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:06.482 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:06.482 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.91 2023-08-23T01:00:06.672 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:06.677 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:06.677 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.92 2023-08-23T01:00:06.874 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:06.879 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:06.879 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.93 2023-08-23T01:00:07.065 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:07.070 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:07.070 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.94 2023-08-23T01:00:07.274 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:07.280 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:07.280 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.95 2023-08-23T01:00:07.488 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:07.484+0000 7f7cff02d700 0 -- 172.21.15.12:0/1432235362 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x559f8cb83580 msgr2=0x559f8cafafd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:07.489 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:07.494 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:07.494 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.96 2023-08-23T01:00:07.690 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:07.688+0000 7f4cb0fd1700 0 -- 172.21.15.12:0/1855661822 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f4c90033b00 msgr2=0x7f4c90035f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-08-23T01:00:07.699 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:07.704 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:07.705 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.97 2023-08-23T01:00:07.892 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:07.888+0000 7fa970d09700 0 -- 172.21.15.12:0/2856914445 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7fa950033b00 msgr2=0x7fa950035f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:07.899 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:07.904 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:07.904 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.98 2023-08-23T01:00:08.111 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:08.116 INFO:tasks.workunit.client.0.smithi012.stderr:+ for i in $(seq -w 00 99) 2023-08-23T01:00:08.116 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm image.99 2023-08-23T01:00:08.316 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:08.320 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_remove 2023-08-23T01:00:08.320 INFO:tasks.workunit.client.0.smithi012.stdout:testing remove... 2023-08-23T01:00:08.321 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing remove...' 2023-08-23T01:00:08.321 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:00:08.321 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:08.434 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:08.552 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:08.676 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:08.801 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:08.929 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:09.052 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:09.176 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:09.305 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:09.419 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:09.549 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:09.676 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:09.792 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:09.915 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:10.036 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:10.366 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:10.488 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:10.609 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:10.732 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd remove NOT_EXIST 2023-08-23T01:00:10.806 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 0% complete...failed. 2023-08-23T01:00:10.807 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: delete error: (2) No such file or directory 2023-08-23T01:00:10.811 INFO:tasks.workunit.client.0.smithi012.stderr:+ true 2023-08-23T01:00:10.811 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 1 -s 1 test1 2023-08-23T01:00:10.839 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: image format 1 is deprecated 2023-08-23T01:00:10.852 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:10.848+0000 7f7624c7d340 -1 librbd: Forced V1 image creation. 2023-08-23T01:00:10.867 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:00:10.935 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:10.941 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:00:10.941 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:00:10.943 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:00:10.982 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:00:10.983 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 -s 1 test2 2023-08-23T01:00:11.056 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:00:11.262 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:11.260+0000 7fecf3be2700 0 -- 172.21.15.12:0/446703411 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7fecd4033bd0 msgr2=0x7fecd4036000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:11.271 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:11.277 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:00:11.278 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:00:11.278 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:00:11.319 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:00:11.319 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 1 -s 1 test1 2023-08-23T01:00:11.347 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: image format 1 is deprecated 2023-08-23T01:00:11.361 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:11.356+0000 7f155c782340 -1 librbd: Forced V1 image creation. 2023-08-23T01:00:11.373 INFO:tasks.workunit.client.0.smithi012.stderr:+ rados rm -p rbd test1.rbd 2023-08-23T01:00:11.415 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:00:11.463 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:11.468 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:00:11.469 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:00:11.469 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:00:11.508 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:00:11.509 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 1 -eq 0 ']' 2023-08-23T01:00:11.509 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 -s 1 test2 2023-08-23T01:00:11.577 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create test2@snap 2023-08-23T01:00:11.890 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:00:11.903 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap protect test2@snap 2023-08-23T01:00:11.963 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone test2@snap clone --rbd-default-clone-format 1 2023-08-23T01:00:12.073 INFO:tasks.workunit.client.0.smithi012.stderr:+ rados -p rbd rm rbd_children 2023-08-23T01:00:12.117 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm clone 2023-08-23T01:00:12.315 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:12.320 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:00:12.321 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep clone 2023-08-23T01:00:12.321 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:00:12.321 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:00:12.365 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:00:12.366 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap unprotect test2@snap 2023-08-23T01:00:12.426 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm test2@snap 2023-08-23T01:00:12.891 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:00:12.913 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:00:13.140 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:13.145 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_migration 2023-08-23T01:00:13.146 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing migration...' 2023-08-23T01:00:13.146 INFO:tasks.workunit.client.0.smithi012.stdout:testing migration... 2023-08-23T01:00:13.147 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:00:13.147 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:13.273 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:13.392 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:13.724 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:13.853 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:13.972 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:14.101 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:14.222 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:14.347 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:14.482 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:14.606 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:14.729 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:14.855 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:14.983 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:15.108 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:15.239 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:15.367 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:15.493 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:15.619 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph osd pool create rbd2 8 2023-08-23T01:00:16.971 INFO:tasks.workunit.client.0.smithi012.stderr:pool 'rbd2' already exists 2023-08-23T01:00:16.979 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd pool init rbd2 2023-08-23T01:00:19.894 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 1 -s 128M test1 2023-08-23T01:00:19.919 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: image format 1 is deprecated 2023-08-23T01:00:19.932 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:19.928+0000 7f1f27daa340 -1 librbd: Forced V1 image creation. 2023-08-23T01:00:19.947 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info test1 2023-08-23T01:00:19.948 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'format: 1' 2023-08-23T01:00:19.995 INFO:tasks.workunit.client.0.smithi012.stdout: format: 1 2023-08-23T01:00:19.995 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test1 --image-format 2 2023-08-23T01:00:20.128 INFO:tasks.workunit.client.0.smithi012.stderr:++ get_migration_state test1 2023-08-23T01:00:20.128 INFO:tasks.workunit.client.0.smithi012.stderr:++ local image=test1 2023-08-23T01:00:20.128 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd --format xml status test1 2023-08-23T01:00:20.129 INFO:tasks.workunit.client.0.smithi012.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-08-23T01:00:20.271 INFO:tasks.workunit.client.0.smithi012.stderr:+ test prepared = prepared 2023-08-23T01:00:20.271 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info test1 2023-08-23T01:00:20.271 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'format: 2' 2023-08-23T01:00:20.342 INFO:tasks.workunit.client.0.smithi012.stdout: format: 2 2023-08-23T01:00:20.342 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:00:20.405 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:20.400+0000 7f2ac3dec340 -1 librbd::image::PreRemoveRequest: 0x55c48c407900 validate_image_removal: image in migration state - not removing 2023-08-23T01:00:20.408 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 0% complete...failed. 2023-08-23T01:00:20.409 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: error: image still has watchers 2023-08-23T01:00:20.409 INFO:tasks.workunit.client.0.smithi012.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2023-08-23T01:00:20.414 INFO:tasks.workunit.client.0.smithi012.stderr:+ true 2023-08-23T01:00:20.414 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration execute test1 2023-08-23T01:00:20.600 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete...2023-08-23T01:00:20.596+0000 7fc89d4e7700 0 -- 172.21.15.12:0/1443334548 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x5626075b6770 msgr2=0x5626076a78e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:20.630 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 93% complete... Image migration: 96% complete...2023-08-23T01:00:20.628+0000 7fc89d4e7700 0 -- 172.21.15.12:0/1443334548 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7fc880034300 msgr2=0x7fc880036730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:20.654 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 100% complete...done. 2023-08-23T01:00:20.658 INFO:tasks.workunit.client.0.smithi012.stderr:++ get_migration_state test1 2023-08-23T01:00:20.658 INFO:tasks.workunit.client.0.smithi012.stderr:++ local image=test1 2023-08-23T01:00:20.659 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd --format xml status test1 2023-08-23T01:00:20.659 INFO:tasks.workunit.client.0.smithi012.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-08-23T01:00:20.768 INFO:tasks.workunit.client.0.smithi012.stderr:+ test executed = executed 2023-08-23T01:00:20.769 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration commit test1 2023-08-23T01:00:20.960 INFO:tasks.workunit.client.0.smithi012.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... 2023-08-23T01:00:20.956+0000 7f5c0bd46700 0 -- 172.21.15.12:0/2486143159 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x55b844ac4010 msgr2=0x55b844bbc6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:20.973 INFO:tasks.workunit.client.0.smithi012.stderr:Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-08-23T01:00:20.968+0000 7f5c0bd46700 0 -- 172.21.15.12:0/2486143159 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f5bec034240 msgr2=0x7f5bec036670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:20.983 INFO:tasks.workunit.client.0.smithi012.stderr: Commit image migration: 100% complete...done. 2023-08-23T01:00:20.987 INFO:tasks.workunit.client.0.smithi012.stderr:+ get_migration_state test1 2023-08-23T01:00:20.987 INFO:tasks.workunit.client.0.smithi012.stderr:+ local image=test1 2023-08-23T01:00:20.988 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd --format xml status test1 2023-08-23T01:00:20.988 INFO:tasks.workunit.client.0.smithi012.stderr:+ xmlstarlet sel -t -v //status/migration/state 2023-08-23T01:00:21.042 INFO:tasks.workunit.client.0.smithi012.stderr:+ true 2023-08-23T01:00:21.043 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info test1 2023-08-23T01:00:21.043 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'features: .*layering' 2023-08-23T01:00:21.095 INFO:tasks.workunit.client.0.smithi012.stderr:+ true 2023-08-23T01:00:21.095 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test1 --image-feature layering,exclusive-lock,object-map,fast-diff,deep-flatten 2023-08-23T01:00:21.279 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info test1 2023-08-23T01:00:21.279 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'features: .*layering' 2023-08-23T01:00:21.355 INFO:tasks.workunit.client.0.smithi012.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten, migrating 2023-08-23T01:00:21.355 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration execute test1 2023-08-23T01:00:21.515 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-08-23T01:00:21.512+0000 7f99f3f5d700 0 -- 172.21.15.12:0/2932715453 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f99d8008780 msgr2=0x7f99d800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:21.547 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 100% complete...done. 2023-08-23T01:00:21.551 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration commit test1 2023-08-23T01:00:21.735 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:21.732+0000 7fd5a10d7700 0 -- 172.21.15.12:0/429908894 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7fd57c008780 msgr2=0x7fd57c00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:21.754 INFO:tasks.workunit.client.0.smithi012.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete...2023-08-23T01:00:21.752+0000 7fd5a10d7700 0 -- 172.21.15.12:0/429908894 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7fd584034310 msgr2=0x7fd584036740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:21.786 INFO:tasks.workunit.client.0.smithi012.stderr: Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete... Commit image migration: 100% complete...done. 2023-08-23T01:00:21.790 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test1 rbd2/test1 2023-08-23T01:00:22.026 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:22.024+0000 7f4326955700 0 --2- 172.21.15.12:0/855776037 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55d597c7dbe0 0x55d597d2a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-08-23T01:00:22.169 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:22.164+0000 7f4326955700 0 -- 172.21.15.12:0/855776037 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f430c036e30 msgr2=0x7f430c039260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:22.188 INFO:tasks.workunit.client.0.smithi012.stderr:++ get_migration_state rbd2/test1 2023-08-23T01:00:22.188 INFO:tasks.workunit.client.0.smithi012.stderr:++ local image=rbd2/test1 2023-08-23T01:00:22.188 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd --format xml status rbd2/test1 2023-08-23T01:00:22.189 INFO:tasks.workunit.client.0.smithi012.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-08-23T01:00:22.330 INFO:tasks.workunit.client.0.smithi012.stderr:+ test prepared = prepared 2023-08-23T01:00:22.330 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:00:22.331 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:00:22.331 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:00:22.374 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:00:22.375 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd -p rbd2 ls 2023-08-23T01:00:22.375 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:00:22.417 INFO:tasks.workunit.client.0.smithi012.stdout:test1 2023-08-23T01:00:22.418 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration execute test1 2023-08-23T01:00:22.585 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-08-23T01:00:22.580+0000 7f18e45d4700 0 -- 172.21.15.12:0/1327132991 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x5581a1a65770 msgr2=0x5581a1b56460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:22.593 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 100% complete...done. 2023-08-23T01:00:22.598 INFO:tasks.workunit.client.0.smithi012.stderr:++ get_migration_state rbd2/test1 2023-08-23T01:00:22.599 INFO:tasks.workunit.client.0.smithi012.stderr:++ local image=rbd2/test1 2023-08-23T01:00:22.599 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd --format xml status rbd2/test1 2023-08-23T01:00:22.599 INFO:tasks.workunit.client.0.smithi012.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-08-23T01:00:22.721 INFO:tasks.workunit.client.0.smithi012.stderr:+ test executed = executed 2023-08-23T01:00:22.721 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm rbd2/test1 2023-08-23T01:00:22.788 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:22.784+0000 7fb62f7fe700 -1 librbd::image::PreRemoveRequest: 0x558267fd4bc0 validate_image_removal: image in migration state - not removing 2023-08-23T01:00:22.798 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 0% complete...failed. 2023-08-23T01:00:22.798 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: error: image still has watchers 2023-08-23T01:00:22.799 INFO:tasks.workunit.client.0.smithi012.stderr:This means the image is still open or the client using it crashed. Try again after closing/unmapping it or waiting 30s for the crashed client to timeout. 2023-08-23T01:00:22.803 INFO:tasks.workunit.client.0.smithi012.stderr:+ true 2023-08-23T01:00:22.804 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration commit test1 2023-08-23T01:00:22.982 INFO:tasks.workunit.client.0.smithi012.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-08-23T01:00:22.980+0000 7fb6a5e86700 0 -- 172.21.15.12:0/805037298 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x5587e456da60 msgr2=0x5587e456fe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-08-23T01:00:22.999 INFO:tasks.workunit.client.0.smithi012.stderr: Commit image migration: 100% complete...done. 2023-08-23T01:00:23.005 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd namespace create rbd2/ns1 2023-08-23T01:00:23.052 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd namespace create rbd2/ns2 2023-08-23T01:00:23.097 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare rbd2/test1 rbd2/ns1/test1 2023-08-23T01:00:23.280 INFO:tasks.workunit.client.0.smithi012.stderr:++ get_migration_state rbd2/ns1/test1 2023-08-23T01:00:23.281 INFO:tasks.workunit.client.0.smithi012.stderr:++ local image=rbd2/ns1/test1 2023-08-23T01:00:23.281 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd --format xml status rbd2/ns1/test1 2023-08-23T01:00:23.281 INFO:tasks.workunit.client.0.smithi012.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-08-23T01:00:23.434 INFO:tasks.workunit.client.0.smithi012.stderr:+ test prepared = prepared 2023-08-23T01:00:23.435 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration execute rbd2/test1 2023-08-23T01:00:23.572 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-08-23T01:00:23.568+0000 7fcd822bc700 0 -- 172.21.15.12:0/8425596 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x562fa6c50940 msgr2=0x562fa6c52d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:23.575 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 100% complete...done. 2023-08-23T01:00:23.581 INFO:tasks.workunit.client.0.smithi012.stderr:++ get_migration_state rbd2/ns1/test1 2023-08-23T01:00:23.581 INFO:tasks.workunit.client.0.smithi012.stderr:++ local image=rbd2/ns1/test1 2023-08-23T01:00:23.582 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd --format xml status rbd2/ns1/test1 2023-08-23T01:00:23.582 INFO:tasks.workunit.client.0.smithi012.stderr:++ xmlstarlet sel -t -v //status/migration/state 2023-08-23T01:00:23.698 INFO:tasks.workunit.client.0.smithi012.stderr:+ test executed = executed 2023-08-23T01:00:23.698 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration commit rbd2/test1 2023-08-23T01:00:23.865 INFO:tasks.workunit.client.0.smithi012.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-08-23T01:00:23.860+0000 7f9a5f4ed700 0 -- 172.21.15.12:0/3534536700 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x5645401bb590 msgr2=0x5645402b16b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:23.881 INFO:tasks.workunit.client.0.smithi012.stderr: Commit image migration: 100% complete...done. 2023-08-23T01:00:23.887 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare rbd2/ns1/test1 rbd2/ns2/test1 2023-08-23T01:00:24.062 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:24.056+0000 7f56f8966700 0 -- 172.21.15.12:0/4145692736 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x560c5893b310 msgr2=0x560c5894b630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:24.071 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration execute rbd2/ns2/test1 2023-08-23T01:00:24.214 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-08-23T01:00:24.212+0000 7f09b945a700 0 -- 172.21.15.12:0/1977033945 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x5581fbda57d0 msgr2=0x5581fbda7bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:24.231 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 100% complete...done. 2023-08-23T01:00:24.235 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration commit rbd2/ns2/test1 2023-08-23T01:00:24.402 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:24.396+0000 7f0623c37700 0 -- 172.21.15.12:0/3607502890 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x5603f7921e10 msgr2=0x5603f7924200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:24.419 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:24.416+0000 7f0624438700 0 -- 172.21.15.12:0/3607502890 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f0604034310 msgr2=0x7f0604036740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:24.449 INFO:tasks.workunit.client.0.smithi012.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete... Commit image migration: 100% complete...done. 2023-08-23T01:00:24.455 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 128M test1 2023-08-23T01:00:24.700 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:24.696+0000 7fa4986ab340 -1 librbd: Forced V1 image creation. 2023-08-23T01:00:24.716 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test1 --data-pool rbd2 2023-08-23T01:00:24.844 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info test1 2023-08-23T01:00:24.845 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'data_pool: rbd2' 2023-08-23T01:00:24.909 INFO:tasks.workunit.client.0.smithi012.stdout: data_pool: rbd2 2023-08-23T01:00:24.909 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration execute test1 2023-08-23T01:00:25.066 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-08-23T01:00:25.064+0000 7f278b7e6700 0 -- 172.21.15.12:0/1840278207 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f2770008780 msgr2=0x7f277000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:25.095 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:25.092+0000 7f278b7e6700 0 -- 172.21.15.12:0/1840278207 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f276c034240 msgr2=0x7f276c036670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:25.105 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 100% complete...done. 2023-08-23T01:00:25.108 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration commit test1 2023-08-23T01:00:25.276 INFO:tasks.workunit.client.0.smithi012.stderr: Commit image migration: 3% complete... Commit image migration: 6% complete... Commit image migration: 9% complete... Commit image migration: 12% complete... Commit image migration: 15% complete... Commit image migration: 18% complete... Commit image migration: 21% complete... Commit image migration: 25% complete... Commit image migration: 28% complete... Commit image migration: 31% complete... Commit image migration: 34% complete... Commit image migration: 37% complete... Commit image migration: 40% complete... Commit image migration: 43% complete... Commit image migration: 46% complete... Commit image migration: 50% complete... Commit image migration: 53% complete... 2023-08-23T01:00:25.272+0000 7f01c4137700 0 -- 172.21.15.12:0/3308763371 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f01a0008780 msgr2=0x7f01a000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:25.293 INFO:tasks.workunit.client.0.smithi012.stderr:Commit image migration: 56% complete... Commit image migration: 59% complete... Commit image migration: 62% complete... Commit image migration: 65% complete... Commit image migration: 68% complete... Commit image migration: 71% complete... Commit image migration: 75% complete... Commit image migration: 78% complete... Commit image migration: 81% complete... Commit image migration: 84% complete... Commit image migration: 87% complete... Commit image migration: 90% complete... Commit image migration: 93% complete... Commit image migration: 96% complete...2023-08-23T01:00:25.288+0000 7f01c4137700 0 -- 172.21.15.12:0/3308763371 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f01ac034310 msgr2=0x7f01ac036740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:25.309 INFO:tasks.workunit.client.0.smithi012.stderr: Commit image migration: 100% complete...done. 2023-08-23T01:00:25.313 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test1 2023-08-23T01:00:25.478 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd trash mv test1 2023-08-23T01:00:25.479 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv test1 2023-08-23T01:00:25.538 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:25.532+0000 7f12115d8340 -1 librbd::api::Trash: move: cannot move migrating image to trash 2023-08-23T01:00:25.543 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: deferred delete error: (16) Device or resource busy 2023-08-23T01:00:25.548 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:00:25.549 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd trash ls -a 2023-08-23T01:00:25.549 INFO:tasks.workunit.client.0.smithi012.stderr:++ cut -d ' ' -f 1 2023-08-23T01:00:25.593 INFO:tasks.workunit.client.0.smithi012.stderr:+ ID=19d984e14832 2023-08-23T01:00:25.593 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd trash rm 19d984e14832 2023-08-23T01:00:25.593 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash rm 19d984e14832 2023-08-23T01:00:25.639 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:25.636+0000 7f602f7fe700 -1 librbd::image::RefreshRequest: image being migrated 2023-08-23T01:00:25.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:25.636+0000 7f602effd700 -1 librbd::image::OpenRequest: failed to refresh image: (30) Read-only file system 2023-08-23T01:00:25.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:25.636+0000 7f602f7fe700 -1 librbd::ImageState: 0x7f601c0489c0 failed to open image: (30) Read-only file system 2023-08-23T01:00:25.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:25.636+0000 7f6025ffb700 -1 librbd::image::RemoveRequest: 0x7f601c000b80 handle_open_image: error opening image: (30) Read-only file system 2023-08-23T01:00:25.642 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: remove error: (30) Read-only file system 2023-08-23T01:00:25.643 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 0% complete...failed. 2023-08-23T01:00:25.647 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:00:25.648 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd trash restore 19d984e14832 2023-08-23T01:00:25.648 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash restore 19d984e14832 2023-08-23T01:00:25.684 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: restore error: 2023-08-23T01:00:25.680+0000 7f56a1866340 -1 librbd::api::Trash: restore: Current trash source 'migration' does not match expected: user,mirroring,unknown (4) 2023-08-23T01:00:25.684 INFO:tasks.workunit.client.0.smithi012.stderr:(22) Invalid argument 2023-08-23T01:00:25.688 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:00:25.689 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration abort test1 2023-08-23T01:00:25.878 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-08-23T01:00:25.876+0000 7fc860565700 0 -- 172.21.15.12:0/642920998 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7fc844008780 msgr2=0x7fc84400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:25.923 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:25.920+0000 7fc860d66700 0 -- 172.21.15.12:0/642920998 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x55f6411213c0 msgr2=0x55f641209560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:25.933 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 100% complete...done. 2023-08-23T01:00:25.938 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd remove test1 2023-08-23T01:00:26.116 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-08-23T01:00:26.121 INFO:tasks.workunit.client.0.smithi012.stderr:+ dd if=/dev/urandom bs=1M count=1 2023-08-23T01:00:26.122 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd --image-format 2 import - test1 2023-08-23T01:00:26.204 INFO:tasks.workunit.client.0.smithi012.stderr:1+0 records in 2023-08-23T01:00:26.205 INFO:tasks.workunit.client.0.smithi012.stderr:1+0 records out 2023-08-23T01:00:26.205 INFO:tasks.workunit.client.0.smithi012.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.08207 s, 12.8 MB/s 2023-08-23T01:00:26.260 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 100% complete...done. 2023-08-23T01:00:26.266 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd export test1 - 2023-08-23T01:00:26.266 INFO:tasks.workunit.client.0.smithi012.stderr:++ md5sum 2023-08-23T01:00:26.325 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 100% complete...done. 2023-08-23T01:00:26.329 INFO:tasks.workunit.client.0.smithi012.stderr:+ md5sum='6a7a30be7169495304ccd5cf6d786148 -' 2023-08-23T01:00:26.330 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create test1@snap1 2023-08-23T01:00:26.919 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:00:26.932 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap protect test1@snap1 2023-08-23T01:00:27.000 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create test1@snap2 2023-08-23T01:00:27.932 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:00:27.946 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone test1@snap1 clone_v1 --rbd_default_clone_format=1 2023-08-23T01:00:28.063 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone test1@snap2 clone_v2 --rbd_default_clone_format=2 2023-08-23T01:00:28.181 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info clone_v1 2023-08-23T01:00:28.181 INFO:tasks.workunit.client.0.smithi012.stderr:+ fgrep 'parent: rbd/test1@snap1' 2023-08-23T01:00:28.259 INFO:tasks.workunit.client.0.smithi012.stdout: parent: rbd/test1@snap1 2023-08-23T01:00:28.260 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info clone_v2 2023-08-23T01:00:28.260 INFO:tasks.workunit.client.0.smithi012.stderr:+ fgrep 'parent: rbd/test1@snap2' 2023-08-23T01:00:28.337 INFO:tasks.workunit.client.0.smithi012.stdout: parent: rbd/test1@snap2 2023-08-23T01:00:28.338 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info clone_v2 2023-08-23T01:00:28.338 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'op_features: clone-child' 2023-08-23T01:00:28.414 INFO:tasks.workunit.client.0.smithi012.stdout: op_features: clone-child 2023-08-23T01:00:28.415 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd export clone_v1 - 2023-08-23T01:00:28.415 INFO:tasks.workunit.client.0.smithi012.stderr:++ md5sum 2023-08-23T01:00:28.489 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 100% complete...done. 2023-08-23T01:00:28.497 INFO:tasks.workunit.client.0.smithi012.stderr:+ test '6a7a30be7169495304ccd5cf6d786148 -' = '6a7a30be7169495304ccd5cf6d786148 -' 2023-08-23T01:00:28.498 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd export clone_v2 - 2023-08-23T01:00:28.498 INFO:tasks.workunit.client.0.smithi012.stderr:++ md5sum 2023-08-23T01:00:28.575 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 100% complete...done. 2023-08-23T01:00:28.582 INFO:tasks.workunit.client.0.smithi012.stderr:+ test '6a7a30be7169495304ccd5cf6d786148 -' = '6a7a30be7169495304ccd5cf6d786148 -' 2023-08-23T01:00:28.582 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd children test1@snap1 2023-08-23T01:00:28.665 INFO:tasks.workunit.client.0.smithi012.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-08-23T01:00:28.666 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd children test1@snap2 2023-08-23T01:00:28.734 INFO:tasks.workunit.client.0.smithi012.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-08-23T01:00:28.734 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test1 rbd2/test2 2023-08-23T01:00:28.913 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:28.908+0000 7f65f5506700 0 -- 172.21.15.12:0/3628240346 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f65d80341a0 msgr2=0x7f65d80365d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:30.934 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:30.932+0000 7f65f5506700 0 -- 172.21.15.12:0/3628240346 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x5618c11593c0 msgr2=0x7f65d8036bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:31.075 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info clone_v1 2023-08-23T01:00:31.076 INFO:tasks.workunit.client.0.smithi012.stderr:+ fgrep 'parent: rbd2/test2@snap1' 2023-08-23T01:00:31.182 INFO:tasks.workunit.client.0.smithi012.stdout: parent: rbd2/test2@snap1 2023-08-23T01:00:31.183 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info clone_v2 2023-08-23T01:00:31.183 INFO:tasks.workunit.client.0.smithi012.stderr:+ fgrep 'parent: rbd2/test2@snap2' 2023-08-23T01:00:31.293 INFO:tasks.workunit.client.0.smithi012.stdout: parent: rbd2/test2@snap2 2023-08-23T01:00:31.294 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info clone_v2 2023-08-23T01:00:31.294 INFO:tasks.workunit.client.0.smithi012.stderr:+ fgrep 'op_features: clone-child' 2023-08-23T01:00:31.402 INFO:tasks.workunit.client.0.smithi012.stdout: op_features: clone-child 2023-08-23T01:00:31.403 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd children rbd2/test2@snap1 2023-08-23T01:00:31.515 INFO:tasks.workunit.client.0.smithi012.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-08-23T01:00:31.515 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd children rbd2/test2@snap2 2023-08-23T01:00:31.617 INFO:tasks.workunit.client.0.smithi012.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-08-23T01:00:31.617 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration execute test1 2023-08-23T01:00:31.774 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 100% complete...done. 2023-08-23T01:00:31.779 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd migration commit test1 2023-08-23T01:00:31.779 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration commit test1 2023-08-23T01:00:31.925 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: the image has descendants: 2023-08-23T01:00:31.926 INFO:tasks.workunit.client.0.smithi012.stderr: rbd/clone_v1 2023-08-23T01:00:31.926 INFO:tasks.workunit.client.0.smithi012.stderr: rbd/clone_v2 2023-08-23T01:00:31.927 INFO:tasks.workunit.client.0.smithi012.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-08-23T01:00:31.927 INFO:tasks.workunit.client.0.smithi012.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2023-08-23T01:00:31.930 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:00:31.931 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration commit test1 --force 2023-08-23T01:00:32.075 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: the image has descendants: 2023-08-23T01:00:32.076 INFO:tasks.workunit.client.0.smithi012.stderr: rbd/clone_v1 2023-08-23T01:00:32.076 INFO:tasks.workunit.client.0.smithi012.stderr: rbd/clone_v2 2023-08-23T01:00:32.076 INFO:tasks.workunit.client.0.smithi012.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-08-23T01:00:32.076 INFO:tasks.workunit.client.0.smithi012.stderr:Proceeding anyway due to force flag set. 2023-08-23T01:00:32.106 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:32.104+0000 7f45cc825700 0 -- 172.21.15.12:0/4092564981 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x562fa3b11d60 msgr2=0x562fa3b14150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:32.124 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:32.120+0000 7f45cc825700 0 -- 172.21.15.12:0/4092564981 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f45ac034340 msgr2=0x7f45ac036770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:33.991 INFO:tasks.workunit.client.0.smithi012.stderr: Commit image migration: 100% complete...done. 2023-08-23T01:00:33.997 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd export clone_v1 - 2023-08-23T01:00:33.997 INFO:tasks.workunit.client.0.smithi012.stderr:++ md5sum 2023-08-23T01:00:34.070 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 100% complete...done. 2023-08-23T01:00:34.077 INFO:tasks.workunit.client.0.smithi012.stderr:+ test '6a7a30be7169495304ccd5cf6d786148 -' = '6a7a30be7169495304ccd5cf6d786148 -' 2023-08-23T01:00:34.079 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd export clone_v2 - 2023-08-23T01:00:34.079 INFO:tasks.workunit.client.0.smithi012.stderr:++ md5sum 2023-08-23T01:00:34.157 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 100% complete...done. 2023-08-23T01:00:34.163 INFO:tasks.workunit.client.0.smithi012.stderr:+ test '6a7a30be7169495304ccd5cf6d786148 -' = '6a7a30be7169495304ccd5cf6d786148 -' 2023-08-23T01:00:34.163 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare rbd2/test2 test1 2023-08-23T01:00:34.355 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:34.352+0000 7f386c6c7700 0 -- 172.21.15.12:0/4201618603 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f38440046d0 msgr2=0x7f3844004b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:35.881 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:35.876+0000 7f386c6c7700 0 -- 172.21.15.12:0/4201618603 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f384c034410 msgr2=0x7f384c036840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:36.015 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info clone_v1 2023-08-23T01:00:36.015 INFO:tasks.workunit.client.0.smithi012.stderr:+ fgrep 'parent: rbd/test1@snap1' 2023-08-23T01:00:36.128 INFO:tasks.workunit.client.0.smithi012.stdout: parent: rbd/test1@snap1 2023-08-23T01:00:36.129 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info clone_v2 2023-08-23T01:00:36.129 INFO:tasks.workunit.client.0.smithi012.stderr:+ fgrep 'parent: rbd/test1@snap2' 2023-08-23T01:00:36.234 INFO:tasks.workunit.client.0.smithi012.stdout: parent: rbd/test1@snap2 2023-08-23T01:00:36.234 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info clone_v2 2023-08-23T01:00:36.235 INFO:tasks.workunit.client.0.smithi012.stderr:+ fgrep 'op_features: clone-child' 2023-08-23T01:00:36.339 INFO:tasks.workunit.client.0.smithi012.stdout: op_features: clone-child 2023-08-23T01:00:36.340 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd children test1@snap1 2023-08-23T01:00:36.455 INFO:tasks.workunit.client.0.smithi012.stderr:+ test rbd/clone_v1 = rbd/clone_v1 2023-08-23T01:00:36.455 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd children test1@snap2 2023-08-23T01:00:36.557 INFO:tasks.workunit.client.0.smithi012.stderr:+ test rbd/clone_v2 = rbd/clone_v2 2023-08-23T01:00:36.557 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration execute test1 2023-08-23T01:00:36.748 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 100% complete...done. 2023-08-23T01:00:36.753 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd migration commit test1 2023-08-23T01:00:36.753 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration commit test1 2023-08-23T01:00:36.907 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: the image has descendants: 2023-08-23T01:00:36.908 INFO:tasks.workunit.client.0.smithi012.stderr: rbd/clone_v1 2023-08-23T01:00:36.908 INFO:tasks.workunit.client.0.smithi012.stderr: rbd/clone_v2 2023-08-23T01:00:36.908 INFO:tasks.workunit.client.0.smithi012.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-08-23T01:00:36.908 INFO:tasks.workunit.client.0.smithi012.stderr:Ensure no descendant images are opened read-only and run again with force flag. 2023-08-23T01:00:36.912 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:00:36.913 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration commit test1 --force 2023-08-23T01:00:37.067 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: the image has descendants: 2023-08-23T01:00:37.067 INFO:tasks.workunit.client.0.smithi012.stderr: rbd/clone_v1 2023-08-23T01:00:37.067 INFO:tasks.workunit.client.0.smithi012.stderr: rbd/clone_v2 2023-08-23T01:00:37.067 INFO:tasks.workunit.client.0.smithi012.stderr:Warning: in-use, read-only descendant images will not detect the parent update. 2023-08-23T01:00:37.067 INFO:tasks.workunit.client.0.smithi012.stderr:Proceeding anyway due to force flag set. 2023-08-23T01:00:37.075 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:37.072+0000 7f1586b8e700 0 -- 172.21.15.12:0/2330988197 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f156c008780 msgr2=0x7f156c00abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:37.104 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:37.100+0000 7f1586b8e700 0 -- 172.21.15.12:0/2330988197 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f1568034410 msgr2=0x7f1568036840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:39.021 INFO:tasks.workunit.client.0.smithi012.stderr: Commit image migration: 100% complete...done. 2023-08-23T01:00:39.028 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd export clone_v1 - 2023-08-23T01:00:39.028 INFO:tasks.workunit.client.0.smithi012.stderr:++ md5sum 2023-08-23T01:00:39.103 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 100% complete...done. 2023-08-23T01:00:39.110 INFO:tasks.workunit.client.0.smithi012.stderr:+ test '6a7a30be7169495304ccd5cf6d786148 -' = '6a7a30be7169495304ccd5cf6d786148 -' 2023-08-23T01:00:39.111 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd export clone_v2 - 2023-08-23T01:00:39.111 INFO:tasks.workunit.client.0.smithi012.stderr:++ md5sum 2023-08-23T01:00:39.189 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 100% complete...done. 2023-08-23T01:00:39.196 INFO:tasks.workunit.client.0.smithi012.stderr:+ test '6a7a30be7169495304ccd5cf6d786148 -' = '6a7a30be7169495304ccd5cf6d786148 -' 2023-08-23T01:00:39.196 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd remove clone_v1 2023-08-23T01:00:39.411 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:39.417 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd remove clone_v2 2023-08-23T01:00:39.620 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:39.615+0000 7fb3528b0700 0 -- 172.21.15.12:0/1548164053 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x555ebd8aa9a0 msgr2=0x555ebd8bbe70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:39.623 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:39.627 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap unprotect test1@snap1 2023-08-23T01:00:39.904 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap purge test1 2023-08-23T01:00:41.985 INFO:tasks.workunit.client.0.smithi012.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-08-23T01:00:42.000 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:00:42.192 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:42.187+0000 7fc636426700 0 -- 172.21.15.12:0/3939152366 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x55e095943240 msgr2=0x55e095943620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-08-23T01:00:42.193 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:42.198 INFO:tasks.workunit.client.0.smithi012.stderr:+ for format in 1 2 2023-08-23T01:00:42.199 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 128M --image-format 1 test2 2023-08-23T01:00:42.227 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: image format 1 is deprecated 2023-08-23T01:00:42.241 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:42.235+0000 7fa840950340 -1 librbd: Forced V1 image creation. 2023-08-23T01:00:42.253 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-08-23T01:00:42.391 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:42.458 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:42.468 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:42.468 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 83.3351 bytes/sec: 83 KiB/s 2023-08-23T01:00:42.478 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration abort test2 2023-08-23T01:00:42.621 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-08-23T01:00:42.615+0000 7f9a4e8bf700 0 -- 172.21.15.12:0/1176756047 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x555e20556e20 msgr2=0x555e20559210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:42.641 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 100% complete...done. 2023-08-23T01:00:42.646 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:42.703 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:42.709 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:42.709 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 250.006 bytes/sec: 250 KiB/s 2023-08-23T01:00:42.718 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:00:42.791 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-08-23T01:00:42.794 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 128M --image-format 1 test2 2023-08-23T01:00:42.819 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: image format 1 is deprecated 2023-08-23T01:00:42.828 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:42.823+0000 7f26477d4340 -1 librbd: Forced V1 image creation. 2023-08-23T01:00:42.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-08-23T01:00:42.963 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:43.028 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:43.036 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:43.036 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-08-23T01:00:43.049 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration execute test2 2023-08-23T01:00:43.207 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-08-23T01:00:43.203+0000 7f2a4e277700 0 -- 172.21.15.12:0/580199715 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x55c41a3b2490 msgr2=0x55c41a49c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:43.235 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:43.231+0000 7f2a4e277700 0 -- 172.21.15.12:0/580199715 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f2a300344b0 msgr2=0x7f2a300368e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:43.244 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 100% complete...done. 2023-08-23T01:00:43.247 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration abort test2 2023-08-23T01:00:43.379 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-08-23T01:00:43.375+0000 7f998a80f700 0 -- 172.21.15.12:0/152535026 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x5574dd74f370 msgr2=0x5574dd7517f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:43.408 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 100% complete...done. 2023-08-23T01:00:43.413 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:43.470 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:43.476 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:43.476 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-08-23T01:00:43.484 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:00:43.569 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-08-23T01:00:43.572 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 128M --image-format 1 test2 2023-08-23T01:00:43.598 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: image format 1 is deprecated 2023-08-23T01:00:43.609 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:43.603+0000 7f8991dd6340 -1 librbd: Forced V1 image creation. 2023-08-23T01:00:43.620 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2023-08-23T01:00:43.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:43.683+0000 7f2454993340 -1 librbd::image::CreateRequest: 0x557860e2a950 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2023-08-23T01:00:43.689 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:43.683+0000 7f2454993340 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2023-08-23T01:00:43.706 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: preparing migration failed: (2) No such file or directory 2023-08-23T01:00:43.712 INFO:tasks.workunit.client.0.smithi012.stderr:+ true 2023-08-23T01:00:43.712 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:43.766 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:43.772 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:43.772 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 250.005 bytes/sec: 250 KiB/s 2023-08-23T01:00:43.781 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:00:43.859 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-08-23T01:00:43.862 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 128M --image-format 1 test2 2023-08-23T01:00:43.886 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: image format 1 is deprecated 2023-08-23T01:00:43.897 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:43.891+0000 7fe17cf11340 -1 librbd: Forced V1 image creation. 2023-08-23T01:00:43.909 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test2 rbd2/test2 2023-08-23T01:00:44.025 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2023-08-23T01:00:44.093 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:44.100 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:44.100 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-08-23T01:00:44.109 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration abort test2 2023-08-23T01:00:44.228 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-08-23T01:00:44.232 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:44.284 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:44.291 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:44.291 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-08-23T01:00:44.299 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:00:44.374 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-08-23T01:00:44.377 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 128M --image-format 1 test2 2023-08-23T01:00:44.401 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: image format 1 is deprecated 2023-08-23T01:00:44.411 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:44.407+0000 7fc988521340 -1 librbd: Forced V1 image creation. 2023-08-23T01:00:44.424 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test2 rbd2/test2 2023-08-23T01:00:44.546 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration abort rbd2/test2 2023-08-23T01:00:44.682 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-08-23T01:00:44.675+0000 7f3453850700 0 -- 172.21.15.12:0/2898781999 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f342c004bc0 msgr2=0x7f342c006fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-08-23T01:00:44.696 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 100% complete...done. 2023-08-23T01:00:44.701 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:44.754 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:44.761 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:44.761 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 250.005 bytes/sec: 250 KiB/s 2023-08-23T01:00:44.769 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:00:44.851 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-08-23T01:00:44.855 INFO:tasks.workunit.client.0.smithi012.stderr:+ test 1 = 1 2023-08-23T01:00:44.855 INFO:tasks.workunit.client.0.smithi012.stderr:+ continue 2023-08-23T01:00:44.856 INFO:tasks.workunit.client.0.smithi012.stderr:+ for format in 1 2 2023-08-23T01:00:44.856 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 128M --image-format 2 test2 2023-08-23T01:00:44.920 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-08-23T01:00:45.103 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:45.099+0000 7f345c36c700 0 -- 172.21.15.12:0/1208967202 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f343c0344b0 msgr2=0x7f343c0368e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:45.116 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:45.192 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:45.202 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:45.203 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 83.3351 bytes/sec: 83 KiB/s 2023-08-23T01:00:45.215 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration abort test2 2023-08-23T01:00:45.426 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-08-23T01:00:45.423+0000 7f4bd36f4700 0 -- 172.21.15.12:0/4004504289 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x556c90862490 msgr2=0x556c9094a230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:45.427 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 100% complete...done. 2023-08-23T01:00:45.432 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:45.498 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:45.501 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:45.502 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 250.005 bytes/sec: 250 KiB/s 2023-08-23T01:00:45.516 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:00:45.718 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-08-23T01:00:45.711+0000 7f9a6da47700 0 -- 172.21.15.12:0/1454208230 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x55a127195300 msgr2=0x55a127236740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:45.726 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:45.730 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 128M --image-format 2 test2 2023-08-23T01:00:45.795 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test2 --data-pool rbd2 2023-08-23T01:00:45.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:45.991+0000 7fdfc437a700 0 -- 172.21.15.12:0/2615394509 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x56122bd8a690 msgr2=0x56122bde3c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:46.000 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:46.083 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:46.097 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:46.097 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 83.3351 bytes/sec: 83 KiB/s 2023-08-23T01:00:46.113 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration execute test2 2023-08-23T01:00:46.290 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 3% complete... Image migration: 6% complete... Image migration: 9% complete... Image migration: 12% complete... Image migration: 15% complete... Image migration: 18% complete... Image migration: 21% complete... Image migration: 25% complete... Image migration: 28% complete... Image migration: 31% complete... Image migration: 34% complete... Image migration: 37% complete... Image migration: 40% complete... Image migration: 43% complete... Image migration: 46% complete... Image migration: 50% complete... Image migration: 53% complete... Image migration: 56% complete... Image migration: 59% complete... Image migration: 62% complete... Image migration: 65% complete... Image migration: 68% complete... Image migration: 71% complete... Image migration: 75% complete... Image migration: 78% complete... Image migration: 81% complete... Image migration: 84% complete... Image migration: 87% complete... Image migration: 90% complete... Image migration: 93% complete... Image migration: 96% complete...2023-08-23T01:00:46.287+0000 7f03255e8700 0 -- 172.21.15.12:0/2435579468 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x55f7f453f3c0 msgr2=0x55f7f4627560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:46.324 INFO:tasks.workunit.client.0.smithi012.stderr: Image migration: 100% complete...done. 2023-08-23T01:00:46.327 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration abort test2 2023-08-23T01:00:46.536 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete...2023-08-23T01:00:46.527+0000 7efe5c6b7700 0 -- 172.21.15.12:0/4280323562 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x56281a420110 msgr2=0x56281a5239e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:46.536 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 100% complete...done. 2023-08-23T01:00:46.539 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:46.607 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:46.814 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:46.815 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 4.8078 bytes/sec: 4.8 KiB/s 2023-08-23T01:00:46.831 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:00:47.033 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-08-23T01:00:47.027+0000 7f169b1b9700 0 -- 172.21.15.12:0/561641186 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x564cc4640d30 msgr2=0x564cc4641110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-08-23T01:00:47.034 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:47.039 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 128M --image-format 2 test2 2023-08-23T01:00:47.108 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test2 --data-pool INVALID_DATA_POOL 2023-08-23T01:00:47.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:47.231+0000 7fb5185cd340 -1 librbd::image::CreateRequest: 0x56033539a950 validate_data_pool: data pool INVALID_DATA_POOL does not exist 2023-08-23T01:00:47.234 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:47.231+0000 7fb5185cd340 -1 librbd::Migration: create_dst_image: header creation failed: (2) No such file or directory 2023-08-23T01:00:47.283 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: preparing migration failed: (2) No such file or directory 2023-08-23T01:00:47.287 INFO:tasks.workunit.client.0.smithi012.stderr:+ true 2023-08-23T01:00:47.288 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:47.356 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:47.367 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:47.367 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 83.3351 bytes/sec: 83 KiB/s 2023-08-23T01:00:47.393 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:00:47.596 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-08-23T01:00:47.591+0000 7f6051c52700 0 -- 172.21.15.12:0/2124531753 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x5633bae18980 msgr2=0x5633badd2490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:47.598 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:47.603 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 128M --image-format 2 test2 2023-08-23T01:00:47.668 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test2 rbd2/test2 2023-08-23T01:00:47.855 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/test2 2023-08-23T01:00:47.937 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:47.946 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:47.946 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-08-23T01:00:47.958 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration abort test2 2023-08-23T01:00:48.146 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-08-23T01:00:48.151 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:48.222 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:48.227 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:48.227 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 250.005 bytes/sec: 250 KiB/s 2023-08-23T01:00:48.246 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:00:48.453 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-08-23T01:00:48.447+0000 7f1dfc159700 0 -- 172.21.15.12:0/2403081415 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f1de0008780 msgr2=0x7f1de000abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:48.454 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:48.458 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 128M --image-format 2 test2 2023-08-23T01:00:48.532 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test2 rbd2/test2 2023-08-23T01:00:48.733 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration abort rbd2/test2 2023-08-23T01:00:48.912 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-08-23T01:00:48.916 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:48.990 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:48.999 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:48.999 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 125.003 bytes/sec: 125 KiB/s 2023-08-23T01:00:49.020 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:00:49.229 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-08-23T01:00:49.223+0000 7f6928b67700 0 -- 172.21.15.12:0/1238467940 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f6904008780 msgr2=0x7f690400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:49.229 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:49.233 INFO:tasks.workunit.client.0.smithi012.stderr:+ test 2 = 1 2023-08-23T01:00:49.234 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 128M --image-format 2 test2 2023-08-23T01:00:49.303 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration prepare test2 rbd2/ns1/test3 2023-08-23T01:00:49.481 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:49.475+0000 7f1d87470700 0 -- 172.21.15.12:0/3450962453 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x558488cfe0d0 msgr2=0x558488da5650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:00:49.493 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 rbd2/ns1/test3 2023-08-23T01:00:49.582 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:49.592 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:49.592 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 83.3351 bytes/sec: 83 KiB/s 2023-08-23T01:00:49.605 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd migration abort test2 2023-08-23T01:00:49.783 INFO:tasks.workunit.client.0.smithi012.stderr: Abort image migration: 1% complete... Abort image migration: 3% complete... Abort image migration: 4% complete... Abort image migration: 6% complete... Abort image migration: 7% complete... Abort image migration: 9% complete... Abort image migration: 10% complete... Abort image migration: 12% complete... Abort image migration: 14% complete... Abort image migration: 15% complete... Abort image migration: 17% complete... Abort image migration: 18% complete... Abort image migration: 20% complete... Abort image migration: 21% complete... Abort image migration: 23% complete... Abort image migration: 25% complete... Abort image migration: 26% complete... Abort image migration: 28% complete... Abort image migration: 29% complete... Abort image migration: 31% complete... Abort image migration: 32% complete... Abort image migration: 34% complete... Abort image migration: 35% complete... Abort image migration: 37% complete... Abort image migration: 39% complete... Abort image migration: 40% complete... Abort image migration: 42% complete... Abort image migration: 43% complete... Abort image migration: 45% complete... Abort image migration: 46% complete... Abort image migration: 48% complete... Abort image migration: 50% complete... Abort image migration: 51% complete... Abort image migration: 53% complete... Abort image migration: 54% complete... Abort image migration: 56% complete... Abort image migration: 57% complete... Abort image migration: 59% complete... Abort image migration: 60% complete... Abort image migration: 62% complete... Abort image migration: 64% complete... Abort image migration: 65% complete... Abort image migration: 67% complete... Abort image migration: 68% complete... Abort image migration: 70% complete... Abort image migration: 71% complete... Abort image migration: 73% complete... Abort image migration: 75% complete... Abort image migration: 76% complete... Abort image migration: 78% complete... Abort image migration: 79% complete... Abort image migration: 81% complete... Abort image migration: 82% complete... Abort image migration: 84% complete... Abort image migration: 85% complete... Abort image migration: 87% complete... Abort image migration: 89% complete... Abort image migration: 90% complete... Abort image migration: 92% complete... Abort image migration: 93% complete... Abort image migration: 95% complete... Abort image migration: 96% complete... Abort image migration: 98% complete... Abort image migration: 100% complete...done. 2023-08-23T01:00:49.788 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-size 1024 --io-total 1024 test2 2023-08-23T01:00:49.856 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 1024 io_threads 16 bytes 1024 pattern sequential 2023-08-23T01:00:49.860 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:00:49.861 INFO:tasks.workunit.client.0.smithi012.stdout:elapsed: 0 ops: 1 ops/sec: 250.005 bytes/sec: 250 KiB/s 2023-08-23T01:00:49.877 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:00:50.060 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-08-23T01:00:50.055+0000 7f3795645700 0 -- 172.21.15.12:0/1998839491 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f37780342e0 msgr2=0x7f3778036710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-08-23T01:00:50.075 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:50.080 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:00:50.080 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:50.210 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:50.332 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:50.463 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:50.592 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:50.715 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:50.844 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:50.970 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:51.099 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:51.222 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:51.352 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:51.480 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:51.606 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:51.735 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:51.862 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:51.980 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:52.105 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:52.230 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:52.360 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-08-23T01:00:52.983 INFO:tasks.workunit.client.0.smithi012.stderr:pool 'rbd2' does not exist 2023-08-23T01:00:52.992 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_config 2023-08-23T01:00:52.992 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing config...' 2023-08-23T01:00:52.992 INFO:tasks.workunit.client.0.smithi012.stdout:testing config... 2023-08-23T01:00:52.993 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:00:52.993 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:53.119 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:53.243 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:53.372 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:53.504 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:53.628 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:53.759 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:53.889 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:54.018 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:54.153 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:54.282 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:54.407 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:54.541 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:54.678 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:54.806 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:54.935 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:55.272 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:55.402 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:55.530 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd config global set osd rbd_cache true 2023-08-23T01:00:55.530 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global set osd rbd_cache true 2023-08-23T01:00:55.560 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: invalid config entity: osd (must be global, client or client.) 2023-08-23T01:00:55.561 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:00:55.562 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd config global set global debug_ms 10 2023-08-23T01:00:55.562 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global set global debug_ms 10 2023-08-23T01:00:55.590 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: not rbd option: debug_ms 2023-08-23T01:00:55.592 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:00:55.592 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd config global set global rbd_UNKNOWN false 2023-08-23T01:00:55.592 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global set global rbd_UNKNOWN false 2023-08-23T01:00:55.623 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: invalid config key: rbd_UNKNOWN 2023-08-23T01:00:55.624 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:00:55.624 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd config global set global rbd_cache INVALID 2023-08-23T01:00:55.625 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global set global rbd_cache INVALID 2023-08-23T01:00:55.662 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: error setting rbd_cache: error parsing value: Expected option value to be integer, got 'INVALID' 2023-08-23T01:00:55.666 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:00:55.666 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global set global rbd_cache false 2023-08-23T01:00:55.710 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global set client rbd_cache true 2023-08-23T01:00:55.757 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global set client.123 rbd_cache false 2023-08-23T01:00:55.806 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global get global rbd_cache 2023-08-23T01:00:55.806 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^false$' 2023-08-23T01:00:55.849 INFO:tasks.workunit.client.0.smithi012.stdout:false 2023-08-23T01:00:55.850 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global get client rbd_cache 2023-08-23T01:00:55.850 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^true$' 2023-08-23T01:00:55.891 INFO:tasks.workunit.client.0.smithi012.stdout:true 2023-08-23T01:00:55.892 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global get client.123 rbd_cache 2023-08-23T01:00:55.892 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^false$' 2023-08-23T01:00:55.931 INFO:tasks.workunit.client.0.smithi012.stdout:false 2023-08-23T01:00:55.932 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd config global get client.UNKNOWN rbd_cache 2023-08-23T01:00:55.932 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global get client.UNKNOWN rbd_cache 2023-08-23T01:00:55.966 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: rbd_cache is not set 2023-08-23T01:00:55.970 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:00:55.971 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global list global 2023-08-23T01:00:55.971 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^rbd_cache * false * global *$' 2023-08-23T01:00:56.010 INFO:tasks.workunit.client.0.smithi012.stdout:rbd_cache false global 2023-08-23T01:00:56.010 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global list client 2023-08-23T01:00:56.010 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^rbd_cache * true * client *$' 2023-08-23T01:00:56.048 INFO:tasks.workunit.client.0.smithi012.stdout:rbd_cache true client 2023-08-23T01:00:56.049 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global list client.123 2023-08-23T01:00:56.050 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^rbd_cache * false * client.123 *$' 2023-08-23T01:00:56.090 INFO:tasks.workunit.client.0.smithi012.stdout:rbd_cache false client.123 2023-08-23T01:00:56.091 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^rbd_cache * true * client *$' 2023-08-23T01:00:56.091 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global list client.UNKNOWN 2023-08-23T01:00:56.130 INFO:tasks.workunit.client.0.smithi012.stdout:rbd_cache true client 2023-08-23T01:00:56.130 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global rm client rbd_cache 2023-08-23T01:00:56.176 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd config global get client rbd_cache 2023-08-23T01:00:56.176 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global get client rbd_cache 2023-08-23T01:00:56.211 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: rbd_cache is not set 2023-08-23T01:00:56.214 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:00:56.215 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global list client 2023-08-23T01:00:56.215 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^rbd_cache * false * global *$' 2023-08-23T01:00:56.256 INFO:tasks.workunit.client.0.smithi012.stdout:rbd_cache false global 2023-08-23T01:00:56.256 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global rm client.123 rbd_cache 2023-08-23T01:00:56.305 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config global rm global rbd_cache 2023-08-23T01:00:56.353 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config pool set rbd rbd_cache true 2023-08-23T01:00:56.412 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config pool list rbd 2023-08-23T01:00:56.412 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^rbd_cache * true * pool *$' 2023-08-23T01:00:56.452 INFO:tasks.workunit.client.0.smithi012.stdout:rbd_cache true pool 2023-08-23T01:00:56.453 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config pool get rbd rbd_cache 2023-08-23T01:00:56.453 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^true$' 2023-08-23T01:00:56.497 INFO:tasks.workunit.client.0.smithi012.stdout:true 2023-08-23T01:00:56.498 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 1 test1 2023-08-23T01:00:56.535 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:56.531+0000 7fb7d196c340 -1 librbd: Forced V1 image creation. 2023-08-23T01:00:56.550 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config image list rbd/test1 2023-08-23T01:00:56.551 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^rbd_cache * true * pool *$' 2023-08-23T01:00:56.609 INFO:tasks.workunit.client.0.smithi012.stdout:rbd_cache true pool 2023-08-23T01:00:56.610 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config image set rbd/test1 rbd_cache false 2023-08-23T01:00:56.680 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config image list rbd/test1 2023-08-23T01:00:56.680 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^rbd_cache * false * image *$' 2023-08-23T01:00:56.743 INFO:tasks.workunit.client.0.smithi012.stdout:rbd_cache false image 2023-08-23T01:00:56.744 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config image get rbd/test1 rbd_cache 2023-08-23T01:00:56.744 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^false$' 2023-08-23T01:00:56.804 INFO:tasks.workunit.client.0.smithi012.stdout:false 2023-08-23T01:00:56.805 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config image remove rbd/test1 rbd_cache 2023-08-23T01:00:56.874 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd config image get rbd/test1 rbd_cache 2023-08-23T01:00:56.875 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config image get rbd/test1 rbd_cache 2023-08-23T01:00:56.925 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: rbd_cache is not set 2023-08-23T01:00:56.933 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:00:56.934 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config image list rbd/test1 2023-08-23T01:00:56.934 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^rbd_cache * true * pool *$' 2023-08-23T01:00:56.999 INFO:tasks.workunit.client.0.smithi012.stdout:rbd_cache true pool 2023-08-23T01:00:56.999 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config pool remove rbd rbd_cache 2023-08-23T01:00:57.055 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd config pool get rbd rbd_cache 2023-08-23T01:00:57.055 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config pool get rbd rbd_cache 2023-08-23T01:00:57.094 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: rbd_cache is not set 2023-08-23T01:00:57.098 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:00:57.098 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd config pool list rbd 2023-08-23T01:00:57.099 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^rbd_cache * true * config *$' 2023-08-23T01:00:57.137 INFO:tasks.workunit.client.0.smithi012.stdout:rbd_cache true config 2023-08-23T01:00:57.137 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:00:57.202 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:00:57.207 INFO:tasks.workunit.client.0.smithi012.stderr:+ RBD_CREATE_ARGS= 2023-08-23T01:00:57.207 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_others 2023-08-23T01:00:57.207 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing import, export, resize, and snapshots...' 2023-08-23T01:00:57.208 INFO:tasks.workunit.client.0.smithi012.stdout:testing import, export, resize, and snapshots... 2023-08-23T01:00:57.208 INFO:tasks.workunit.client.0.smithi012.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2023-08-23T01:00:57.209 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:00:57.209 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:57.335 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:57.464 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:57.593 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:57.717 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:57.845 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:57.967 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:58.095 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:58.222 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:58.347 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:58.469 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:58.599 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:58.722 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:58.856 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:58.982 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:59.112 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:59.238 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:59.361 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:00:59.492 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-08-23T01:00:59.494 INFO:tasks.workunit.client.0.smithi012.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2023-08-23T01:00:59.495 INFO:tasks.workunit.client.0.smithi012.stderr:1+0 records in 2023-08-23T01:00:59.495 INFO:tasks.workunit.client.0.smithi012.stderr:1+0 records out 2023-08-23T01:00:59.495 INFO:tasks.workunit.client.0.smithi012.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.000182825 s, 5.6 MB/s 2023-08-23T01:00:59.496 INFO:tasks.workunit.client.0.smithi012.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2023-08-23T01:00:59.497 INFO:tasks.workunit.client.0.smithi012.stderr:10+0 records in 2023-08-23T01:00:59.497 INFO:tasks.workunit.client.0.smithi012.stderr:10+0 records out 2023-08-23T01:00:59.497 INFO:tasks.workunit.client.0.smithi012.stderr:10240 bytes (10 kB, 10 KiB) copied, 0.000242858 s, 42.2 MB/s 2023-08-23T01:00:59.497 INFO:tasks.workunit.client.0.smithi012.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2023-08-23T01:00:59.498 INFO:tasks.workunit.client.0.smithi012.stderr:70+1 records in 2023-08-23T01:00:59.498 INFO:tasks.workunit.client.0.smithi012.stderr:70+1 records out 2023-08-23T01:00:59.498 INFO:tasks.workunit.client.0.smithi012.stderr:72056 bytes (72 kB, 70 KiB) copied, 0.000320562 s, 225 MB/s 2023-08-23T01:00:59.499 INFO:tasks.workunit.client.0.smithi012.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2023-08-23T01:00:59.500 INFO:tasks.workunit.client.0.smithi012.stderr:138+1 records in 2023-08-23T01:00:59.501 INFO:tasks.workunit.client.0.smithi012.stderr:138+1 records out 2023-08-23T01:00:59.501 INFO:tasks.workunit.client.0.smithi012.stderr:142144 bytes (142 kB, 139 KiB) copied, 0.000971768 s, 146 MB/s 2023-08-23T01:00:59.501 INFO:tasks.workunit.client.0.smithi012.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2023-08-23T01:00:59.502 INFO:tasks.workunit.client.0.smithi012.stderr:74+1 records in 2023-08-23T01:00:59.502 INFO:tasks.workunit.client.0.smithi012.stderr:74+1 records out 2023-08-23T01:00:59.502 INFO:tasks.workunit.client.0.smithi012.stderr:76160 bytes (76 kB, 74 KiB) copied, 0.000336096 s, 227 MB/s 2023-08-23T01:00:59.503 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd import /tmp/img1 testimg1 2023-08-23T01:00:59.539 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:00:59.535+0000 7fd24269f340 -1 librbd: Forced V1 image creation. 2023-08-23T01:00:59.648 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2023-08-23T01:00:59.652 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2023-08-23T01:00:59.699 INFO:tasks.workunit.client.0.smithi012.stderr: Resizing image: 100% complete...done. 2023-08-23T01:00:59.706 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg1 /tmp/img2 2023-08-23T01:00:59.841 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-08-23T01:00:59.845 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg1 --snap=snap1 2023-08-23T01:01:00.918 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:01:00.926 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd resize testimg1 --size=128 2023-08-23T01:01:00.976 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2023-08-23T01:01:00.984 INFO:tasks.workunit.client.0.smithi012.stderr:+ true 2023-08-23T01:01:00.985 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2023-08-23T01:01:01.065 INFO:tasks.workunit.client.0.smithi012.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2023-08-23T01:01:01.072 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg1 /tmp/img3 2023-08-23T01:01:01.171 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:01.176 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg1 2023-08-23T01:01:01.176 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 128 MiB' 2023-08-23T01:01:01.224 INFO:tasks.workunit.client.0.smithi012.stdout: size 128 MiB in 32 objects 2023-08-23T01:01:01.225 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info --snap=snap1 testimg1 2023-08-23T01:01:01.226 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:01.276 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:01.276 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2023-08-23T01:01:01.277 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2023-08-23T01:01:01.418 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:01.422 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2023-08-23T01:01:01.502 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 100% complete...done. 2023-08-23T01:01:01.507 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --size=1 testimg-diff1 2023-08-23T01:01:01.538 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:01:01.531+0000 7fa1431b7340 -1 librbd: Forced V1 image creation. 2023-08-23T01:01:01.550 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2023-08-23T01:01:01.920 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2023-08-23T01:01:01.928 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2023-08-23T01:01:02.006 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2023-08-23T01:01:02.012 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg1 2023-08-23T01:01:02.013 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 128 MiB' 2023-08-23T01:01:02.063 INFO:tasks.workunit.client.0.smithi012.stdout: size 128 MiB in 32 objects 2023-08-23T01:01:02.064 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:02.064 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info --snap=snap1 testimg1 2023-08-23T01:01:02.111 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:02.112 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg-diff1 2023-08-23T01:01:02.112 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 128 MiB' 2023-08-23T01:01:02.166 INFO:tasks.workunit.client.0.smithi012.stdout: size 128 MiB in 32 objects 2023-08-23T01:01:02.167 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-08-23T01:01:02.167 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:02.225 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:02.225 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2023-08-23T01:01:02.569 INFO:tasks.workunit.client.0.smithi012.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-08-23T01:01:02.573 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd copy testimg1 testimg3 2023-08-23T01:01:02.712 INFO:tasks.workunit.client.0.smithi012.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-08-23T01:01:02.716 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2023-08-23T01:01:02.858 INFO:tasks.workunit.client.0.smithi012.stderr: Image copy: 1% complete... Image copy: 3% complete... Image copy: 4% complete... Image copy: 6% complete... Image copy: 7% complete... Image copy: 9% complete... Image copy: 10% complete... Image copy: 12% complete... Image copy: 14% complete... Image copy: 15% complete... Image copy: 17% complete... Image copy: 18% complete... Image copy: 20% complete... Image copy: 21% complete... Image copy: 23% complete... Image copy: 25% complete... Image copy: 26% complete... Image copy: 28% complete... Image copy: 29% complete... Image copy: 31% complete... Image copy: 32% complete... Image copy: 34% complete... Image copy: 35% complete... Image copy: 37% complete... Image copy: 39% complete... Image copy: 40% complete... Image copy: 42% complete... Image copy: 43% complete... Image copy: 45% complete... Image copy: 46% complete... Image copy: 48% complete... Image copy: 50% complete... Image copy: 51% complete... Image copy: 53% complete... Image copy: 54% complete... Image copy: 56% complete... Image copy: 57% complete... Image copy: 59% complete... Image copy: 60% complete... Image copy: 62% complete... Image copy: 64% complete... Image copy: 65% complete... Image copy: 67% complete... Image copy: 68% complete... Image copy: 70% complete... Image copy: 71% complete... Image copy: 73% complete... Image copy: 75% complete... Image copy: 76% complete... Image copy: 78% complete... Image copy: 79% complete... Image copy: 81% complete... Image copy: 82% complete... Image copy: 84% complete... Image copy: 85% complete... Image copy: 87% complete... Image copy: 89% complete... Image copy: 90% complete... Image copy: 92% complete... Image copy: 93% complete... Image copy: 95% complete... Image copy: 96% complete... Image copy: 98% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-08-23T01:01:02.861 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2023-08-23T01:01:02.987 INFO:tasks.workunit.client.0.smithi012.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-08-23T01:01:02.991 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg2 2023-08-23T01:01:02.991 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:03.245 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:03.246 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg3 2023-08-23T01:01:03.246 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 128 MiB' 2023-08-23T01:01:03.305 INFO:tasks.workunit.client.0.smithi012.stdout: size 128 MiB in 32 objects 2023-08-23T01:01:03.306 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg-diff2 2023-08-23T01:01:03.306 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:03.363 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:03.364 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg-diff3 2023-08-23T01:01:03.364 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 128 MiB' 2023-08-23T01:01:03.421 INFO:tasks.workunit.client.0.smithi012.stdout: size 128 MiB in 32 objects 2023-08-23T01:01:03.421 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd deep copy testimg1 testimg4 2023-08-23T01:01:04.005 INFO:tasks.workunit.client.0.smithi012.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-08-23T01:01:04.009 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2023-08-23T01:01:05.015 INFO:tasks.workunit.client.0.smithi012.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-08-23T01:01:05.025 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg4 2023-08-23T01:01:05.025 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 128 MiB' 2023-08-23T01:01:05.071 INFO:tasks.workunit.client.0.smithi012.stdout: size 128 MiB in 32 objects 2023-08-23T01:01:05.072 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg5 2023-08-23T01:01:05.072 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:05.123 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:05.124 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap ls testimg4 2023-08-23T01:01:05.125 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -v SNAPID 2023-08-23T01:01:05.125 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:01:05.125 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:01:05.180 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:01:05.181 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap ls testimg4 2023-08-23T01:01:05.182 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '.*snap1.*' 2023-08-23T01:01:05.235 INFO:tasks.workunit.client.0.smithi012.stdout: 18 snap1 256 MiB Wed Aug 23 01:01:03 2023 2023-08-23T01:01:05.236 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg1 /tmp/img1.new 2023-08-23T01:01:05.358 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:05.360 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg2 /tmp/img2.new 2023-08-23T01:01:05.478 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:05.482 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg3 /tmp/img3.new 2023-08-23T01:01:05.567 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:05.573 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2023-08-23T01:01:05.656 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:05.662 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2023-08-23T01:01:05.810 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:05.814 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2023-08-23T01:01:05.928 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:05.932 INFO:tasks.workunit.client.0.smithi012.stderr:+ cmp /tmp/img2 /tmp/img2.new 2023-08-23T01:01:06.163 INFO:tasks.workunit.client.0.smithi012.stderr:+ cmp /tmp/img3 /tmp/img3.new 2023-08-23T01:01:06.280 INFO:tasks.workunit.client.0.smithi012.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2023-08-23T01:01:06.475 INFO:tasks.workunit.client.0.smithi012.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2023-08-23T01:01:06.577 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rollback --snap=snap1 testimg1 2023-08-23T01:01:06.696 INFO:tasks.workunit.client.0.smithi012.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-08-23T01:01:06.701 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2023-08-23T01:01:06.823 INFO:tasks.workunit.client.0.smithi012.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-08-23T01:01:06.829 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg1 2023-08-23T01:01:06.829 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:06.873 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:06.874 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:06.874 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg-diff1 2023-08-23T01:01:06.922 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:06.922 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg1 /tmp/img1.snap1 2023-08-23T01:01:07.062 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:07.065 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2023-08-23T01:01:07.207 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:07.211 INFO:tasks.workunit.client.0.smithi012.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2023-08-23T01:01:07.396 INFO:tasks.workunit.client.0.smithi012.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2023-08-23T01:01:07.586 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm testimg2 2023-08-23T01:01:07.741 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-08-23T01:01:07.735+0000 7fce198c1700 0 -- 172.21.15.12:0/2401615659 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x55f73813f680 msgr2=0x55f7381fccf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-08-23T01:01:07.777 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:01:07.781 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm testimg3 2023-08-23T01:01:07.946 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete... Removing image: 100% complete...done. 2023-08-23T01:01:07.950 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create testimg2 -s 0 2023-08-23T01:01:07.984 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:01:07.979+0000 7f85c46aa340 -1 librbd: Forced V1 image creation. 2023-08-23T01:01:07.996 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd cp testimg2 testimg3 2023-08-23T01:01:08.095 INFO:tasks.workunit.client.0.smithi012.stderr: Image copy: 100% complete...done. 2023-08-23T01:01:08.100 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd deep cp testimg2 testimg6 2023-08-23T01:01:08.184 INFO:tasks.workunit.client.0.smithi012.stderr: Image deep copy: 100% complete...done. 2023-08-23T01:01:08.189 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm --snap=snap1 testimg1 2023-08-23T01:01:09.081 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:01:09.092 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2023-08-23T01:01:10.086 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:01:10.094 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info --snap=snap1 testimg1 2023-08-23T01:01:10.094 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-08-23T01:01:10.344 INFO:tasks.workunit.client.0.smithi012.stdout:error setting snapshot context: (2) No such file or directory 2023-08-23T01:01:10.344 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-08-23T01:01:10.345 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-08-23T01:01:10.397 INFO:tasks.workunit.client.0.smithi012.stdout:error setting snapshot context: (2) No such file or directory 2023-08-23T01:01:10.397 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd sparsify testimg1 2023-08-23T01:01:10.544 INFO:tasks.workunit.client.0.smithi012.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2023-08-23T01:01:10.552 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:01:10.552 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:10.722 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:10.852 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:11.082 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:12.493 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:13.283 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:13.508 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:13.680 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:13.934 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:14.181 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:14.306 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:14.433 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:14.568 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:14.695 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:14.818 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:14.948 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:15.079 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:15.213 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:15.343 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-08-23T01:01:15.446 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_locking 2023-08-23T01:01:15.447 INFO:tasks.workunit.client.0.smithi012.stdout:testing locking... 2023-08-23T01:01:15.447 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing locking...' 2023-08-23T01:01:15.448 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:01:15.448 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:15.572 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:15.712 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:15.840 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:15.975 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:16.099 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:16.227 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:16.362 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:16.486 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:16.825 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:16.959 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:17.093 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:17.218 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:17.349 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:17.482 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:17.616 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:17.748 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:17.880 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:18.011 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create -s 1 test1 2023-08-23T01:01:18.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:01:18.047+0000 7f892dcbb340 -1 librbd: Forced V1 image creation. 2023-08-23T01:01:18.067 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:01:18.067 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:01:18.067 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:18.114 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:01:18.115 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock add test1 id 2023-08-23T01:01:18.179 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:18.179 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep ' 1 ' 2023-08-23T01:01:18.231 INFO:tasks.workunit.client.0.smithi012.stdout:There is 1 exclusive lock on this image. 2023-08-23T01:01:18.232 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd lock list test1 2023-08-23T01:01:18.233 INFO:tasks.workunit.client.0.smithi012.stderr:++ tail -n 1 2023-08-23T01:01:18.233 INFO:tasks.workunit.client.0.smithi012.stderr:++ awk '{print $1;}' 2023-08-23T01:01:18.283 INFO:tasks.workunit.client.0.smithi012.stderr:+ LOCKER=client.7765 2023-08-23T01:01:18.283 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock remove test1 id client.7765 2023-08-23T01:01:18.900 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:18.901 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:01:18.901 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:01:18.947 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:01:18.948 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock add test1 id --shared tag 2023-08-23T01:01:19.015 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:19.015 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep ' 1 ' 2023-08-23T01:01:19.061 INFO:tasks.workunit.client.0.smithi012.stdout:There is 1 shared lock on this image. 2023-08-23T01:01:19.062 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock add test1 id --shared tag 2023-08-23T01:01:19.131 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:19.131 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep ' 2 ' 2023-08-23T01:01:19.182 INFO:tasks.workunit.client.0.smithi012.stdout:There are 2 shared locks on this image. 2023-08-23T01:01:19.183 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock add test1 id2 --shared tag 2023-08-23T01:01:19.251 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:19.251 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep ' 3 ' 2023-08-23T01:01:19.303 INFO:tasks.workunit.client.0.smithi012.stdout:There are 3 shared locks on this image. 2023-08-23T01:01:19.304 INFO:tasks.workunit.client.0.smithi012.stderr:+ tail -n 1 2023-08-23T01:01:19.305 INFO:tasks.workunit.client.0.smithi012.stderr:+ awk '{print $2, $1;}' 2023-08-23T01:01:19.305 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:19.305 INFO:tasks.workunit.client.0.smithi012.stderr:+ xargs rbd lock remove test1 2023-08-23T01:01:19.919 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info test1 2023-08-23T01:01:19.919 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -qE 'features:.*exclusive' 2023-08-23T01:01:19.970 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:01:20.043 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:01:20.048 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_thick_provision 2023-08-23T01:01:20.049 INFO:tasks.workunit.client.0.smithi012.stdout:testing thick provision... 2023-08-23T01:01:20.049 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing thick provision...' 2023-08-23T01:01:20.049 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:01:20.049 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:20.181 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:20.523 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:20.652 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:20.790 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:20.924 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:21.046 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:21.178 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:21.306 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:21.434 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:21.564 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:21.690 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:21.818 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:21.947 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:22.076 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:22.198 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:22.331 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:22.464 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:22.598 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --thick-provision -s 64M test1 2023-08-23T01:01:22.640 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:01:22.635+0000 7f84d501c340 -1 librbd: Forced V1 image creation. 2023-08-23T01:01:22.907 INFO:tasks.workunit.client.0.smithi012.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-08-23T01:01:22.914 INFO:tasks.workunit.client.0.smithi012.stderr:+ count=0 2023-08-23T01:01:22.915 INFO:tasks.workunit.client.0.smithi012.stderr:+ ret= 2023-08-23T01:01:22.915 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 0 -lt 10 ']' 2023-08-23T01:01:22.915 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:01:22.915 INFO:tasks.workunit.client.0.smithi012.stderr:+ tr -s ' ' 2023-08-23T01:01:22.916 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^64 MiB' 2023-08-23T01:01:22.916 INFO:tasks.workunit.client.0.smithi012.stderr:+ cut -d ' ' -f 4-5 2023-08-23T01:01:22.916 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd du 2023-08-23T01:01:22.954 INFO:tasks.workunit.client.0.smithi012.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-08-23T01:01:22.963 INFO:tasks.workunit.client.0.smithi012.stdout:64 MiB 2023-08-23T01:01:22.964 INFO:tasks.workunit.client.0.smithi012.stderr:+ ret=0 2023-08-23T01:01:22.964 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 0 = 0 ']' 2023-08-23T01:01:22.966 INFO:tasks.workunit.client.0.smithi012.stderr:+ break 2023-08-23T01:01:22.966 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd du 2023-08-23T01:01:23.009 INFO:tasks.workunit.client.0.smithi012.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-08-23T01:01:23.015 INFO:tasks.workunit.client.0.smithi012.stdout:NAME PROVISIONED USED 2023-08-23T01:01:23.015 INFO:tasks.workunit.client.0.smithi012.stdout:test1 64 MiB 64 MiB 2023-08-23T01:01:23.019 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 0 '!=' 0 ']' 2023-08-23T01:01:23.019 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:01:23.113 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete... Removing image: 100% complete...done. 2023-08-23T01:01:23.117 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:01:23.117 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:01:23.118 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:01:23.118 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:01:23.148 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:01:23.149 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --thick-provision -s 4G test1 2023-08-23T01:01:23.185 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:01:23.179+0000 7f3565fc2340 -1 librbd: Forced V1 image creation. 2023-08-23T01:01:24.201 INFO:tasks.workunit.client.0.smithi012.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete... Thick provisioning: 6% complete... Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete... Thick provisioning: 10% complete... Thick provisioning: 11% complete...2023-08-23T01:01:24.194+0000 7f35643f0700 0 -- 172.21.15.12:0/2477503022 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x56098ba7b380 msgr2=0x56098ba7d770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-08-23T01:01:24.438 INFO:tasks.workunit.client.0.smithi012.stderr: Thick provisioning: 12% complete... Thick provisioning: 13% complete...2023-08-23T01:01:24.430+0000 7f35643f0700 0 -- 172.21.15.12:0/2477503022 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f3544033ca0 msgr2=0x7f35440360d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:01:33.267 INFO:tasks.workunit.client.0.smithi012.stderr: Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-08-23T01:01:33.274 INFO:tasks.workunit.client.0.smithi012.stderr:+ count=0 2023-08-23T01:01:33.275 INFO:tasks.workunit.client.0.smithi012.stderr:+ ret= 2023-08-23T01:01:33.275 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 0 -lt 10 ']' 2023-08-23T01:01:33.275 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd du 2023-08-23T01:01:33.275 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:01:33.276 INFO:tasks.workunit.client.0.smithi012.stderr:+ tr -s ' ' 2023-08-23T01:01:33.276 INFO:tasks.workunit.client.0.smithi012.stderr:+ cut -d ' ' -f 4-5 2023-08-23T01:01:33.276 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^4 GiB' 2023-08-23T01:01:33.313 INFO:tasks.workunit.client.0.smithi012.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-08-23T01:01:33.369 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:01:33.362+0000 7f32dbbdf700 0 -- 172.21.15.12:0/4197782314 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x55bbea5b0880 msgr2=0x55bbea5be910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:01:33.373 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:01:33.366+0000 7f32db3de700 0 -- 172.21.15.12:0/4197782314 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x55bbea5c5fb0 msgr2=0x55bbea5c83a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:01:33.535 INFO:tasks.workunit.client.0.smithi012.stdout:4 GiB 2023-08-23T01:01:33.536 INFO:tasks.workunit.client.0.smithi012.stderr:+ ret=0 2023-08-23T01:01:33.536 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 0 = 0 ']' 2023-08-23T01:01:33.536 INFO:tasks.workunit.client.0.smithi012.stderr:+ break 2023-08-23T01:01:33.536 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd du 2023-08-23T01:01:33.568 INFO:tasks.workunit.client.0.smithi012.stderr:warning: fast-diff map is not enabled for test1. operation may be slow. 2023-08-23T01:01:33.587 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:01:33.582+0000 7fcbb03a1700 0 -- 172.21.15.12:0/3642038565 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x5583f1fadcf0 msgr2=0x5583f1fbd1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:01:33.590 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:01:33.582+0000 7fcbafba0700 0 -- 172.21.15.12:0/3642038565 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x5583f1fc0810 msgr2=0x5583f1fc2c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:01:33.729 INFO:tasks.workunit.client.0.smithi012.stdout:NAME PROVISIONED USED 2023-08-23T01:01:33.729 INFO:tasks.workunit.client.0.smithi012.stdout:test1 4 GiB 4 GiB 2023-08-23T01:01:33.731 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 0 '!=' 0 ']' 2023-08-23T01:01:33.732 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:01:33.881 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete...2023-08-23T01:01:33.874+0000 7f37a0850700 0 -- 172.21.15.12:0/3832568367 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x5571d815f680 msgr2=0x5571d8161a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:01:33.898 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 11% complete... Removing image: 12% complete...2023-08-23T01:01:33.890+0000 7f37a0850700 0 -- 172.21.15.12:0/3832568367 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f3784033d30 msgr2=0x7f3784036160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:01:34.805 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2023-08-23T01:01:34.808 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:01:34.808 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:01:34.808 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:01:34.808 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:01:34.838 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:01:34.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ RBD_CREATE_ARGS='--image-format 2' 2023-08-23T01:01:34.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_others 2023-08-23T01:01:34.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing import, export, resize, and snapshots...' 2023-08-23T01:01:34.840 INFO:tasks.workunit.client.0.smithi012.stdout:testing import, export, resize, and snapshots... 2023-08-23T01:01:34.840 INFO:tasks.workunit.client.0.smithi012.stderr:+ TMP_FILES='/tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1' 2023-08-23T01:01:34.841 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:01:34.841 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:34.950 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:35.071 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:35.195 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:35.319 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:35.443 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:35.570 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:35.707 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:35.841 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:35.979 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:36.111 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:36.243 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:36.375 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:36.509 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:36.650 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:36.774 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:36.912 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:37.042 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:37.176 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-08-23T01:01:37.177 INFO:tasks.workunit.client.0.smithi012.stderr:+ dd if=/bin/sh of=/tmp/img1 bs=1k count=1 seek=10 2023-08-23T01:01:37.178 INFO:tasks.workunit.client.0.smithi012.stderr:1+0 records in 2023-08-23T01:01:37.179 INFO:tasks.workunit.client.0.smithi012.stderr:1+0 records out 2023-08-23T01:01:37.179 INFO:tasks.workunit.client.0.smithi012.stderr:1024 bytes (1.0 kB, 1.0 KiB) copied, 0.00018194 s, 5.6 MB/s 2023-08-23T01:01:37.179 INFO:tasks.workunit.client.0.smithi012.stderr:+ dd if=/bin/dd of=/tmp/img1 bs=1k count=10 seek=100 2023-08-23T01:01:37.180 INFO:tasks.workunit.client.0.smithi012.stderr:10+0 records in 2023-08-23T01:01:37.180 INFO:tasks.workunit.client.0.smithi012.stderr:10+0 records out 2023-08-23T01:01:37.180 INFO:tasks.workunit.client.0.smithi012.stderr:10240 bytes (10 kB, 10 KiB) copied, 0.000216493 s, 47.3 MB/s 2023-08-23T01:01:37.181 INFO:tasks.workunit.client.0.smithi012.stderr:+ dd if=/bin/rm of=/tmp/img1 bs=1k count=100 seek=1000 2023-08-23T01:01:37.182 INFO:tasks.workunit.client.0.smithi012.stderr:70+1 records in 2023-08-23T01:01:37.182 INFO:tasks.workunit.client.0.smithi012.stderr:70+1 records out 2023-08-23T01:01:37.182 INFO:tasks.workunit.client.0.smithi012.stderr:72056 bytes (72 kB, 70 KiB) copied, 0.000589934 s, 122 MB/s 2023-08-23T01:01:37.183 INFO:tasks.workunit.client.0.smithi012.stderr:+ dd if=/bin/ls of=/tmp/img1 bs=1k seek=10000 2023-08-23T01:01:37.185 INFO:tasks.workunit.client.0.smithi012.stderr:138+1 records in 2023-08-23T01:01:37.185 INFO:tasks.workunit.client.0.smithi012.stderr:138+1 records out 2023-08-23T01:01:37.185 INFO:tasks.workunit.client.0.smithi012.stderr:142144 bytes (142 kB, 139 KiB) copied, 0.000966057 s, 147 MB/s 2023-08-23T01:01:37.188 INFO:tasks.workunit.client.0.smithi012.stderr:+ dd if=/bin/ln of=/tmp/img1 bs=1k seek=100000 2023-08-23T01:01:37.189 INFO:tasks.workunit.client.0.smithi012.stderr:74+1 records in 2023-08-23T01:01:37.189 INFO:tasks.workunit.client.0.smithi012.stderr:74+1 records out 2023-08-23T01:01:37.189 INFO:tasks.workunit.client.0.smithi012.stderr:76160 bytes (76 kB, 74 KiB) copied, 0.000258328 s, 295 MB/s 2023-08-23T01:01:37.189 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd import --image-format 2 /tmp/img1 testimg1 2023-08-23T01:01:37.381 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image: 4% complete... Importing image: 8% complete... Importing image: 12% complete... Importing image: 16% complete... Importing image: 20% complete... Importing image: 24% complete... Importing image: 28% complete... Importing image: 32% complete... Importing image: 36% complete... Importing image: 40% complete... Importing image: 45% complete... Importing image: 49% complete... Importing image: 53% complete... Importing image: 57% complete... Importing image: 61% complete... Importing image: 65% complete... Importing image: 69% complete... Importing image: 73% complete... Importing image: 77% complete... Importing image: 81% complete... Importing image: 85% complete... Importing image: 90% complete... Importing image: 94% complete... Importing image: 98% complete... Importing image: 100% complete...done. 2023-08-23T01:01:37.386 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd resize testimg1 --size=256 --allow-shrink 2023-08-23T01:01:38.023 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:01:38.018+0000 7f7164a03700 0 --2- 172.21.15.12:0/1204301372 >> [v2:172.21.15.12:3300/0,v1:172.21.15.12:6789/0] conn(0x55bc005d0ac0 0x55bc0067b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-08-23T01:01:38.076 INFO:tasks.workunit.client.0.smithi012.stderr: Resizing image: 100% complete...done. 2023-08-23T01:01:38.093 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg1 /tmp/img2 2023-08-23T01:01:38.246 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:38.250 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg1 --snap=snap1 2023-08-23T01:01:38.942 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:01:38.958 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd resize testimg1 --size=128 2023-08-23T01:01:39.018 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: shrinking an image is only allowed with the --allow-shrink flag 2023-08-23T01:01:39.026 INFO:tasks.workunit.client.0.smithi012.stderr:+ true 2023-08-23T01:01:39.026 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd resize testimg1 --size=128 --allow-shrink 2023-08-23T01:01:39.103 INFO:tasks.workunit.client.0.smithi012.stderr: Resizing image: 50% complete... Resizing image: 51% complete... Resizing image: 53% complete... Resizing image: 54% complete... Resizing image: 56% complete... Resizing image: 57% complete... Resizing image: 59% complete... Resizing image: 60% complete... Resizing image: 62% complete... Resizing image: 64% complete... Resizing image: 65% complete... Resizing image: 67% complete... Resizing image: 68% complete... Resizing image: 70% complete... Resizing image: 71% complete... Resizing image: 73% complete... Resizing image: 75% complete... Resizing image: 76% complete... Resizing image: 78% complete... Resizing image: 79% complete... Resizing image: 81% complete... Resizing image: 82% complete... Resizing image: 84% complete... Resizing image: 85% complete... Resizing image: 87% complete... Resizing image: 89% complete... Resizing image: 90% complete... Resizing image: 92% complete... Resizing image: 93% complete... Resizing image: 95% complete... Resizing image: 96% complete... Resizing image: 98% complete... Resizing image: 100% complete...done. 2023-08-23T01:01:39.118 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg1 /tmp/img3 2023-08-23T01:01:39.231 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:39.236 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg1 2023-08-23T01:01:39.236 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 128 MiB' 2023-08-23T01:01:39.290 INFO:tasks.workunit.client.0.smithi012.stdout: size 128 MiB in 32 objects 2023-08-23T01:01:39.291 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:39.291 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info --snap=snap1 testimg1 2023-08-23T01:01:39.354 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:39.354 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm -rf /tmp/diff-testimg1-1 /tmp/diff-testimg1-2 2023-08-23T01:01:39.364 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export-diff testimg1 --snap=snap1 /tmp/diff-testimg1-1 2023-08-23T01:01:39.513 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 3% complete... Exporting image: 37% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:39.517 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export-diff testimg1 --from-snap=snap1 /tmp/diff-testimg1-2 2023-08-23T01:01:39.740 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:01:39.738+0000 7fe5b90ff700 0 --2- 172.21.15.12:0/719671621 >> v2:172.21.15.12:3300/0 conn(0x55ab2b1460e0 0x55ab2b14a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2023-08-23T01:01:39.822 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 100% complete...done. 2023-08-23T01:01:39.827 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size=1 testimg-diff1 2023-08-23T01:01:39.884 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-1 testimg-diff1 2023-08-23T01:01:40.946 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image diff: 22% complete... Importing image diff: 63% complete... Importing image diff: 99% complete... Importing image diff: 100% complete...done. 2023-08-23T01:01:40.961 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd import-diff --sparse-size 8K /tmp/diff-testimg1-2 testimg-diff1 2023-08-23T01:01:41.040 INFO:tasks.workunit.client.0.smithi012.stderr: Importing image diff: 68% complete... Importing image diff: 96% complete... Importing image diff: 100% complete...done. 2023-08-23T01:01:41.057 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg1 2023-08-23T01:01:41.057 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 128 MiB' 2023-08-23T01:01:41.115 INFO:tasks.workunit.client.0.smithi012.stdout: size 128 MiB in 32 objects 2023-08-23T01:01:41.116 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info --snap=snap1 testimg1 2023-08-23T01:01:41.116 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:41.171 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:41.172 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg-diff1 2023-08-23T01:01:41.172 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 128 MiB' 2023-08-23T01:01:41.231 INFO:tasks.workunit.client.0.smithi012.stdout: size 128 MiB in 32 objects 2023-08-23T01:01:41.232 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-08-23T01:01:41.232 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:41.292 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:41.293 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd copy testimg1 --snap=snap1 testimg2 2023-08-23T01:01:41.441 INFO:tasks.workunit.client.0.smithi012.stderr: Image copy: 3% complete... Image copy: 37% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-08-23T01:01:41.445 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd copy testimg1 testimg3 2023-08-23T01:01:41.606 INFO:tasks.workunit.client.0.smithi012.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-08-23T01:01:41.613 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd copy testimg-diff1 --sparse-size 768K --snap=snap1 testimg-diff2 2023-08-23T01:01:41.757 INFO:tasks.workunit.client.0.smithi012.stderr: Image copy: 3% complete... Image copy: 37% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-08-23T01:01:41.762 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd copy testimg-diff1 --sparse-size 768K testimg-diff3 2023-08-23T01:01:41.916 INFO:tasks.workunit.client.0.smithi012.stderr: Image copy: 3% complete... Image copy: 6% complete... Image copy: 9% complete... Image copy: 12% complete... Image copy: 15% complete... Image copy: 18% complete... Image copy: 21% complete... Image copy: 25% complete... Image copy: 28% complete... Image copy: 31% complete... Image copy: 34% complete... Image copy: 37% complete... Image copy: 40% complete... Image copy: 43% complete... Image copy: 46% complete... Image copy: 50% complete... Image copy: 53% complete... Image copy: 56% complete... Image copy: 59% complete... Image copy: 62% complete... Image copy: 65% complete... Image copy: 68% complete... Image copy: 71% complete... Image copy: 75% complete... Image copy: 78% complete... Image copy: 81% complete... Image copy: 84% complete... Image copy: 87% complete... Image copy: 90% complete... Image copy: 93% complete... Image copy: 96% complete... Image copy: 100% complete... Image copy: 100% complete...done. 2023-08-23T01:01:41.920 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg2 2023-08-23T01:01:41.921 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:41.971 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:41.972 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg3 2023-08-23T01:01:41.973 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 128 MiB' 2023-08-23T01:01:42.029 INFO:tasks.workunit.client.0.smithi012.stdout: size 128 MiB in 32 objects 2023-08-23T01:01:42.030 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg-diff2 2023-08-23T01:01:42.030 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:42.089 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:42.090 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg-diff3 2023-08-23T01:01:42.090 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 128 MiB' 2023-08-23T01:01:42.146 INFO:tasks.workunit.client.0.smithi012.stdout: size 128 MiB in 32 objects 2023-08-23T01:01:42.146 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd deep copy testimg1 testimg4 2023-08-23T01:01:42.983 INFO:tasks.workunit.client.0.smithi012.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-08-23T01:01:42.988 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd deep copy testimg1 --snap=snap1 testimg5 2023-08-23T01:01:43.990 INFO:tasks.workunit.client.0.smithi012.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-08-23T01:01:43.995 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg4 2023-08-23T01:01:43.995 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 128 MiB' 2023-08-23T01:01:44.058 INFO:tasks.workunit.client.0.smithi012.stdout: size 128 MiB in 32 objects 2023-08-23T01:01:44.058 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg5 2023-08-23T01:01:44.058 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:44.121 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:44.122 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap ls testimg4 2023-08-23T01:01:44.122 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -v SNAPID 2023-08-23T01:01:44.122 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:01:44.122 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:01:44.180 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:01:44.180 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap ls testimg4 2023-08-23T01:01:44.181 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '.*snap1.*' 2023-08-23T01:01:44.242 INFO:tasks.workunit.client.0.smithi012.stdout: 26 snap1 256 MiB Wed Aug 23 01:01:42 2023 2023-08-23T01:01:44.243 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg1 /tmp/img1.new 2023-08-23T01:01:44.352 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:44.356 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg2 /tmp/img2.new 2023-08-23T01:01:44.500 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:44.504 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg3 /tmp/img3.new 2023-08-23T01:01:44.592 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:44.596 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.new 2023-08-23T01:01:44.694 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:44.697 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg-diff2 /tmp/img-diff2.new 2023-08-23T01:01:44.848 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:44.852 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg-diff3 /tmp/img-diff3.new 2023-08-23T01:01:44.945 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 3% complete... Exporting image: 6% complete... Exporting image: 9% complete... Exporting image: 12% complete... Exporting image: 15% complete... Exporting image: 18% complete... Exporting image: 21% complete... Exporting image: 25% complete... Exporting image: 28% complete... Exporting image: 31% complete... Exporting image: 34% complete... Exporting image: 37% complete... Exporting image: 40% complete... Exporting image: 43% complete... Exporting image: 46% complete... Exporting image: 50% complete... Exporting image: 53% complete... Exporting image: 56% complete... Exporting image: 59% complete... Exporting image: 62% complete... Exporting image: 65% complete... Exporting image: 68% complete... Exporting image: 71% complete... Exporting image: 75% complete... Exporting image: 78% complete... Exporting image: 81% complete... Exporting image: 84% complete... Exporting image: 87% complete... Exporting image: 90% complete... Exporting image: 93% complete... Exporting image: 96% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:44.949 INFO:tasks.workunit.client.0.smithi012.stderr:+ cmp /tmp/img2 /tmp/img2.new 2023-08-23T01:01:45.178 INFO:tasks.workunit.client.0.smithi012.stderr:+ cmp /tmp/img3 /tmp/img3.new 2023-08-23T01:01:45.296 INFO:tasks.workunit.client.0.smithi012.stderr:+ cmp /tmp/img2 /tmp/img-diff2.new 2023-08-23T01:01:45.491 INFO:tasks.workunit.client.0.smithi012.stderr:+ cmp /tmp/img3 /tmp/img-diff3.new 2023-08-23T01:01:45.591 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rollback --snap=snap1 testimg1 2023-08-23T01:01:45.731 INFO:tasks.workunit.client.0.smithi012.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-08-23T01:01:45.743 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rollback --snap=snap1 testimg-diff1 2023-08-23T01:01:45.891 INFO:tasks.workunit.client.0.smithi012.stderr: Rolling back to snapshot: 1% complete... Rolling back to snapshot: 3% complete... Rolling back to snapshot: 4% complete... Rolling back to snapshot: 6% complete... Rolling back to snapshot: 7% complete... Rolling back to snapshot: 9% complete... Rolling back to snapshot: 10% complete... Rolling back to snapshot: 12% complete... Rolling back to snapshot: 14% complete... Rolling back to snapshot: 15% complete... Rolling back to snapshot: 17% complete... Rolling back to snapshot: 18% complete... Rolling back to snapshot: 20% complete... Rolling back to snapshot: 21% complete... Rolling back to snapshot: 23% complete... Rolling back to snapshot: 25% complete... Rolling back to snapshot: 26% complete... Rolling back to snapshot: 28% complete... Rolling back to snapshot: 29% complete... Rolling back to snapshot: 31% complete... Rolling back to snapshot: 32% complete... Rolling back to snapshot: 34% complete... Rolling back to snapshot: 35% complete... Rolling back to snapshot: 37% complete... Rolling back to snapshot: 39% complete... Rolling back to snapshot: 40% complete... Rolling back to snapshot: 42% complete... Rolling back to snapshot: 43% complete... Rolling back to snapshot: 45% complete... Rolling back to snapshot: 46% complete... Rolling back to snapshot: 48% complete... Rolling back to snapshot: 50% complete... Rolling back to snapshot: 51% complete... Rolling back to snapshot: 53% complete... Rolling back to snapshot: 54% complete... Rolling back to snapshot: 56% complete... Rolling back to snapshot: 57% complete... Rolling back to snapshot: 59% complete... Rolling back to snapshot: 60% complete... Rolling back to snapshot: 62% complete... Rolling back to snapshot: 64% complete... Rolling back to snapshot: 65% complete... Rolling back to snapshot: 67% complete... Rolling back to snapshot: 68% complete... Rolling back to snapshot: 70% complete... Rolling back to snapshot: 71% complete... Rolling back to snapshot: 73% complete... Rolling back to snapshot: 75% complete... Rolling back to snapshot: 76% complete... Rolling back to snapshot: 78% complete... Rolling back to snapshot: 79% complete... Rolling back to snapshot: 81% complete... Rolling back to snapshot: 82% complete... Rolling back to snapshot: 84% complete... Rolling back to snapshot: 85% complete... Rolling back to snapshot: 87% complete... Rolling back to snapshot: 89% complete... Rolling back to snapshot: 90% complete... Rolling back to snapshot: 92% complete... Rolling back to snapshot: 93% complete... Rolling back to snapshot: 95% complete... Rolling back to snapshot: 96% complete... Rolling back to snapshot: 98% complete... Rolling back to snapshot: 100% complete...done. 2023-08-23T01:01:45.902 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg1 2023-08-23T01:01:45.903 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:45.957 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:45.957 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg-diff1 2023-08-23T01:01:45.957 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:01:46.006 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:01:46.007 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg1 /tmp/img1.snap1 2023-08-23T01:01:46.144 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:46.148 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd export testimg-diff1 /tmp/img-diff1.snap1 2023-08-23T01:01:46.279 INFO:tasks.workunit.client.0.smithi012.stderr: Exporting image: 1% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 12% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 23% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 37% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 48% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 62% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 73% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 87% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 98% complete... Exporting image: 100% complete...done. 2023-08-23T01:01:46.285 INFO:tasks.workunit.client.0.smithi012.stderr:+ cmp /tmp/img2 /tmp/img1.snap1 2023-08-23T01:01:46.472 INFO:tasks.workunit.client.0.smithi012.stderr:+ cmp /tmp/img2 /tmp/img-diff1.snap1 2023-08-23T01:01:46.664 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm testimg2 2023-08-23T01:01:46.854 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete...2023-08-23T01:01:46.846+0000 7faa99c87700 0 -- 172.21.15.12:0/2929468438 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7faa78008780 msgr2=0x7faa7800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:01:46.879 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:01:46.883 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm testimg3 2023-08-23T01:01:47.095 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 6% complete... Removing image: 9% complete... Removing image: 12% complete... Removing image: 15% complete... Removing image: 18% complete... Removing image: 21% complete... Removing image: 25% complete... Removing image: 28% complete... Removing image: 31% complete... Removing image: 34% complete... Removing image: 37% complete... Removing image: 40% complete... Removing image: 43% complete... Removing image: 46% complete... Removing image: 50% complete... Removing image: 53% complete... Removing image: 56% complete... Removing image: 59% complete... Removing image: 62% complete... Removing image: 65% complete... Removing image: 68% complete... Removing image: 71% complete... Removing image: 75% complete... Removing image: 78% complete... Removing image: 81% complete... Removing image: 84% complete... Removing image: 87% complete... Removing image: 90% complete... Removing image: 93% complete... Removing image: 96% complete...2023-08-23T01:01:47.090+0000 7fbb2b95d700 0 -- 172.21.15.12:0/3169529762 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7fbb08014cd0 msgr2=0x7fbb08011e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:01:47.097 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:01:47.101 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create testimg2 -s 0 2023-08-23T01:01:47.144 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:01:47.138+0000 7f05a049a340 -1 librbd: Forced V1 image creation. 2023-08-23T01:01:47.157 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd cp testimg2 testimg3 2023-08-23T01:01:47.253 INFO:tasks.workunit.client.0.smithi012.stderr: Image copy: 100% complete...done. 2023-08-23T01:01:47.258 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd deep cp testimg2 testimg6 2023-08-23T01:01:47.344 INFO:tasks.workunit.client.0.smithi012.stderr: Image deep copy: 100% complete...done. 2023-08-23T01:01:47.350 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm --snap=snap1 testimg1 2023-08-23T01:01:47.925 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:01:47.943 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm --snap=snap1 testimg-diff1 2023-08-23T01:01:48.935 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:01:48.949 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info --snap=snap1 testimg1 2023-08-23T01:01:48.949 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-08-23T01:01:48.997 INFO:tasks.workunit.client.0.smithi012.stdout:error setting snapshot context: (2) No such file or directory 2023-08-23T01:01:48.998 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info --snap=snap1 testimg-diff1 2023-08-23T01:01:48.998 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'error setting snapshot context: (2) No such file or directory' 2023-08-23T01:01:49.051 INFO:tasks.workunit.client.0.smithi012.stdout:error setting snapshot context: (2) No such file or directory 2023-08-23T01:01:49.052 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd sparsify testimg1 2023-08-23T01:01:49.155 INFO:tasks.workunit.client.0.smithi012.stderr: Image sparsify: 1% complete... Image sparsify: 3% complete... Image sparsify: 4% complete... Image sparsify: 6% complete... Image sparsify: 7% complete... Image sparsify: 9% complete... Image sparsify: 10% complete... Image sparsify: 12% complete... Image sparsify: 14% complete... Image sparsify: 15% complete... Image sparsify: 17% complete... Image sparsify: 18% complete... Image sparsify: 20% complete... Image sparsify: 21% complete... Image sparsify: 23% complete... Image sparsify: 25% complete... Image sparsify: 26% complete... Image sparsify: 28% complete... Image sparsify: 29% complete... Image sparsify: 31% complete... Image sparsify: 32% complete... Image sparsify: 34% complete... Image sparsify: 35% complete... Image sparsify: 37% complete... Image sparsify: 39% complete... Image sparsify: 40% complete... Image sparsify: 42% complete... Image sparsify: 43% complete... Image sparsify: 45% complete... Image sparsify: 46% complete... Image sparsify: 48% complete... Image sparsify: 50% complete... Image sparsify: 51% complete... Image sparsify: 53% complete... Image sparsify: 54% complete... Image sparsify: 56% complete... Image sparsify: 57% complete... Image sparsify: 59% complete... Image sparsify: 60% complete... Image sparsify: 62% complete... Image sparsify: 64% complete... Image sparsify: 65% complete... Image sparsify: 67% complete... Image sparsify: 68% complete... Image sparsify: 70% complete... Image sparsify: 71% complete... Image sparsify: 73% complete... Image sparsify: 75% complete... Image sparsify: 76% complete... Image sparsify: 78% complete... Image sparsify: 79% complete... Image sparsify: 81% complete... Image sparsify: 82% complete... Image sparsify: 84% complete... Image sparsify: 85% complete... Image sparsify: 87% complete... Image sparsify: 89% complete... Image sparsify: 90% complete... Image sparsify: 92% complete... Image sparsify: 93% complete... Image sparsify: 95% complete... Image sparsify: 96% complete... Image sparsify: 98% complete... Image sparsify: 100% complete...done. 2023-08-23T01:01:49.170 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:01:49.170 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:49.457 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:49.585 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:49.805 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:50.166 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:51.201 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:51.427 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:51.744 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:52.015 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:52.300 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:52.445 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:52.582 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:52.711 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:52.840 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:52.971 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:53.108 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:53.245 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:53.384 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:53.514 INFO:tasks.workunit.client.0.smithi012.stderr:+ rm -f /tmp/img1 /tmp/img1.new /tmp/img2 /tmp/img2.new /tmp/img3 /tmp/img3.new /tmp/img-diff1.new /tmp/img-diff2.new /tmp/img-diff3.new /tmp/img1.snap1 /tmp/img1.snap1 /tmp/img-diff1.snap1 2023-08-23T01:01:53.620 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_locking 2023-08-23T01:01:53.620 INFO:tasks.workunit.client.0.smithi012.stdout:testing locking... 2023-08-23T01:01:53.621 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing locking...' 2023-08-23T01:01:53.621 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:01:53.621 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:53.744 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:53.879 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:54.007 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:54.141 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:54.279 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:54.415 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:54.550 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:54.890 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:55.025 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:55.161 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:55.298 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:55.430 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:55.561 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:55.692 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:55.825 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:55.959 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:56.095 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:01:56.227 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 -s 1 test1 2023-08-23T01:01:56.299 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:56.299 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:01:56.303 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:01:56.355 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:01:56.355 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock add test1 id 2023-08-23T01:01:56.435 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:56.435 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep ' 1 ' 2023-08-23T01:01:56.489 INFO:tasks.workunit.client.0.smithi012.stdout:There is 1 exclusive lock on this image. 2023-08-23T01:01:56.490 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd lock list test1 2023-08-23T01:01:56.491 INFO:tasks.workunit.client.0.smithi012.stderr:++ tail -n 1 2023-08-23T01:01:56.491 INFO:tasks.workunit.client.0.smithi012.stderr:++ awk '{print $1;}' 2023-08-23T01:01:56.547 INFO:tasks.workunit.client.0.smithi012.stderr:+ LOCKER=client.8439 2023-08-23T01:01:56.547 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock remove test1 id client.8439 2023-08-23T01:01:56.915 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:56.915 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:01:56.915 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:01:56.964 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:01:56.964 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock add test1 id --shared tag 2023-08-23T01:01:57.038 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:57.039 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep ' 1 ' 2023-08-23T01:01:57.094 INFO:tasks.workunit.client.0.smithi012.stdout:There is 1 shared lock on this image. 2023-08-23T01:01:57.094 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock add test1 id --shared tag 2023-08-23T01:01:57.167 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:57.167 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep ' 2 ' 2023-08-23T01:01:57.225 INFO:tasks.workunit.client.0.smithi012.stdout:There are 2 shared locks on this image. 2023-08-23T01:01:57.225 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock add test1 id2 --shared tag 2023-08-23T01:01:57.300 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:57.301 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep ' 3 ' 2023-08-23T01:01:57.358 INFO:tasks.workunit.client.0.smithi012.stdout:There are 3 shared locks on this image. 2023-08-23T01:01:57.360 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:57.360 INFO:tasks.workunit.client.0.smithi012.stderr:+ tail -n 1 2023-08-23T01:01:57.361 INFO:tasks.workunit.client.0.smithi012.stderr:+ awk '{print $2, $1;}' 2023-08-23T01:01:57.361 INFO:tasks.workunit.client.0.smithi012.stderr:+ xargs rbd lock remove test1 2023-08-23T01:01:57.927 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info test1 2023-08-23T01:01:57.928 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -qE 'features:.*exclusive' 2023-08-23T01:01:57.991 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd lock list test1 2023-08-23T01:01:58.047 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n 'There are 2 shared locks on this image. 2023-08-23T01:01:58.047 INFO:tasks.workunit.client.0.smithi012.stderr:Lock tag: tag 2023-08-23T01:01:58.048 INFO:tasks.workunit.client.0.smithi012.stderr:Locker ID Address 2023-08-23T01:01:58.048 INFO:tasks.workunit.client.0.smithi012.stderr:client.8454 id 172.21.15.12:0/3633488612 2023-08-23T01:01:58.048 INFO:tasks.workunit.client.0.smithi012.stderr:client.8460 id 172.21.15.12:0/3803905249' ']' 2023-08-23T01:01:58.049 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:58.049 INFO:tasks.workunit.client.0.smithi012.stderr:+ tail -n 1 2023-08-23T01:01:58.049 INFO:tasks.workunit.client.0.smithi012.stderr:+ awk '{print $2, $1;}' 2023-08-23T01:01:58.049 INFO:tasks.workunit.client.0.smithi012.stderr:+ xargs rbd lock remove test1 2023-08-23T01:01:58.937 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd lock list test1 2023-08-23T01:01:58.993 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n 'There is 1 shared lock on this image. 2023-08-23T01:01:58.994 INFO:tasks.workunit.client.0.smithi012.stderr:Lock tag: tag 2023-08-23T01:01:58.994 INFO:tasks.workunit.client.0.smithi012.stderr:Locker ID Address 2023-08-23T01:01:58.994 INFO:tasks.workunit.client.0.smithi012.stderr:client.8454 id 172.21.15.12:0/3633488612' ']' 2023-08-23T01:01:58.995 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd lock list test1 2023-08-23T01:01:58.995 INFO:tasks.workunit.client.0.smithi012.stderr:+ tail -n 1 2023-08-23T01:01:58.995 INFO:tasks.workunit.client.0.smithi012.stderr:+ awk '{print $2, $1;}' 2023-08-23T01:01:58.995 INFO:tasks.workunit.client.0.smithi012.stderr:+ xargs rbd lock remove test1 2023-08-23T01:01:59.937 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd lock list test1 2023-08-23T01:01:59.993 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' -n '' ']' 2023-08-23T01:01:59.993 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:02:00.177 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:02:00.170+0000 7fb7059d7700 0 -- 172.21.15.12:0/4291873914 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7fb6e8033e20 msgr2=0x7fb6e8036250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:02:00.185 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:02:00.189 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_clone 2023-08-23T01:02:00.190 INFO:tasks.workunit.client.0.smithi012.stdout:testing clone... 2023-08-23T01:02:00.190 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing clone...' 2023-08-23T01:02:00.190 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:02:00.190 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:00.304 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:00.416 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:00.545 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:00.676 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:00.813 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:00.943 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:01.065 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:01.194 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:01.323 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:01.463 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:01.599 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:01.730 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:01.859 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:01.988 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:02.128 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:02.269 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:02.400 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:02.534 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create test1 --image-format 2 -s 1 2023-08-23T01:02:02.613 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create test1@s1 2023-08-23T01:02:03.101 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:03.114 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap protect test1@s1 2023-08-23T01:02:03.181 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph osd pool create rbd2 8 2023-08-23T01:02:04.188 INFO:tasks.workunit.client.0.smithi012.stderr:pool 'rbd2' already exists 2023-08-23T01:02:04.197 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd pool init rbd2 2023-08-23T01:02:07.125 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone test1@s1 rbd2/clone 2023-08-23T01:02:07.228 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd -p rbd2 ls 2023-08-23T01:02:07.228 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep clone 2023-08-23T01:02:07.267 INFO:tasks.workunit.client.0.smithi012.stdout:clone 2023-08-23T01:02:07.268 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd -p rbd2 ls -l 2023-08-23T01:02:07.269 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep clone 2023-08-23T01:02:07.269 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1@s1 2023-08-23T01:02:07.350 INFO:tasks.workunit.client.0.smithi012.stdout:clone 1 MiB rbd/test1@s1 2 2023-08-23T01:02:07.351 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:02:07.351 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -v clone 2023-08-23T01:02:07.394 INFO:tasks.workunit.client.0.smithi012.stdout:test1 2023-08-23T01:02:07.394 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd flatten rbd2/clone 2023-08-23T01:02:07.477 INFO:tasks.workunit.client.0.smithi012.stderr: Image flatten: 100% complete...done. 2023-08-23T01:02:07.491 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create rbd2/clone@s1 2023-08-23T01:02:08.136 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:08.148 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap protect rbd2/clone@s1 2023-08-23T01:02:08.214 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone rbd2/clone@s1 clone2 2023-08-23T01:02:08.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:02:08.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep clone2 2023-08-23T01:02:08.373 INFO:tasks.workunit.client.0.smithi012.stdout:clone2 2023-08-23T01:02:08.374 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls -l 2023-08-23T01:02:08.374 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep clone2 2023-08-23T01:02:08.374 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep rbd2/clone@s1 2023-08-23T01:02:08.441 INFO:tasks.workunit.client.0.smithi012.stdout:clone2 1 MiB rbd2/clone@s1 2 2023-08-23T01:02:08.442 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd -p rbd2 ls 2023-08-23T01:02:08.442 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -v clone2 2023-08-23T01:02:08.484 INFO:tasks.workunit.client.0.smithi012.stdout:clone 2023-08-23T01:02:08.484 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm clone2 2023-08-23T01:02:08.699 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:02:08.690+0000 7f7af5ac5700 0 -- 172.21.15.12:0/3823728602 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x5581ca05c9f0 msgr2=0x5581ca05cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:02:08.700 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:02:08.703 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap unprotect rbd2/clone@s1 2023-08-23T01:02:08.768 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm rbd2/clone@s1 2023-08-23T01:02:09.143 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:02:09.157 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm rbd2/clone 2023-08-23T01:02:09.323 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:02:09.313+0000 7f7a21b1b700 0 -- 172.21.15.12:0/2251474132 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x555b4c78ca40 msgr2=0x555b4c83dbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:02:09.324 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:02:09.330 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap unprotect test1@s1 2023-08-23T01:02:09.404 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm test1@s1 2023-08-23T01:02:10.143 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:02:10.157 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:02:10.359 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:02:10.365 INFO:tasks.workunit.client.0.smithi012.stderr:+ ceph osd pool rm rbd2 rbd2 --yes-i-really-really-mean-it 2023-08-23T01:02:10.997 INFO:tasks.workunit.client.0.smithi012.stderr:pool 'rbd2' does not exist 2023-08-23T01:02:11.006 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_trash 2023-08-23T01:02:11.006 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing trash...' 2023-08-23T01:02:11.006 INFO:tasks.workunit.client.0.smithi012.stdout:testing trash... 2023-08-23T01:02:11.007 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:02:11.007 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:11.136 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:11.264 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:11.599 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:11.738 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:11.875 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:12.009 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:12.137 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:12.272 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:12.405 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:12.537 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:12.665 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:12.803 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:12.941 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:13.074 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:13.195 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:13.332 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:13.466 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:13.596 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 -s 1 test1 2023-08-23T01:02:13.671 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 -s 1 test2 2023-08-23T01:02:13.738 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:02:13.739 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:02:13.778 INFO:tasks.workunit.client.0.smithi012.stdout:test1 2023-08-23T01:02:13.779 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:02:13.779 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test2 2023-08-23T01:02:13.819 INFO:tasks.workunit.client.0.smithi012.stdout:test2 2023-08-23T01:02:13.820 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:02:13.820 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:13.820 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 2 2023-08-23T01:02:13.861 INFO:tasks.workunit.client.0.smithi012.stdout:2 2023-08-23T01:02:13.862 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls -l 2023-08-23T01:02:13.862 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'test1.*2.*' 2023-08-23T01:02:13.923 INFO:tasks.workunit.client.0.smithi012.stdout:test1 1 MiB 2 2023-08-23T01:02:13.924 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls -l 2023-08-23T01:02:13.924 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'test2.*2.*' 2023-08-23T01:02:13.987 INFO:tasks.workunit.client.0.smithi012.stdout:test2 1 MiB 2 2023-08-23T01:02:13.988 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv test1 2023-08-23T01:02:14.101 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:02:14.101 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test2 2023-08-23T01:02:14.137 INFO:tasks.workunit.client.0.smithi012.stdout:test2 2023-08-23T01:02:14.137 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:14.138 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:02:14.138 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:02:14.180 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:02:14.181 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls -l 2023-08-23T01:02:14.181 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'test2.*2.*' 2023-08-23T01:02:14.236 INFO:tasks.workunit.client.0.smithi012.stdout:test2 1 MiB 2 2023-08-23T01:02:14.236 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:14.237 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:02:14.277 INFO:tasks.workunit.client.0.smithi012.stdout:22571735d277 test1 2023-08-23T01:02:14.278 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:14.278 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:14.279 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:02:14.316 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:02:14.317 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls -l 2023-08-23T01:02:14.318 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'test1.*USER.*' 2023-08-23T01:02:14.371 INFO:tasks.workunit.client.0.smithi012.stdout:22571735d277 test1 USER Wed Aug 23 01:02:14 2023 expired at Wed Aug 23 01:02:14 2023 2023-08-23T01:02:14.372 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls -l 2023-08-23T01:02:14.372 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -v 'protected until' 2023-08-23T01:02:14.427 INFO:tasks.workunit.client.0.smithi012.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2023-08-23T01:02:14.427 INFO:tasks.workunit.client.0.smithi012.stdout:22571735d277 test1 USER Wed Aug 23 01:02:14 2023 expired at Wed Aug 23 01:02:14 2023 2023-08-23T01:02:14.428 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd trash ls 2023-08-23T01:02:14.429 INFO:tasks.workunit.client.0.smithi012.stderr:++ cut -d ' ' -f 1 2023-08-23T01:02:14.469 INFO:tasks.workunit.client.0.smithi012.stderr:+ ID=22571735d277 2023-08-23T01:02:14.470 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash rm 22571735d277 2023-08-23T01:02:14.592 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:02:14.594 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv test2 2023-08-23T01:02:14.700 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd trash ls 2023-08-23T01:02:14.700 INFO:tasks.workunit.client.0.smithi012.stderr:++ cut -d ' ' -f 1 2023-08-23T01:02:14.739 INFO:tasks.workunit.client.0.smithi012.stderr:+ ID=225a825a10f9 2023-08-23T01:02:14.739 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info --image-id 225a825a10f9 2023-08-23T01:02:14.740 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'rbd image '\''test2'\''' 2023-08-23T01:02:14.794 INFO:tasks.workunit.client.0.smithi012.stdout:rbd image 'test2': 2023-08-23T01:02:14.794 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash restore 225a825a10f9 2023-08-23T01:02:14.857 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:02:14.858 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test2 2023-08-23T01:02:14.901 INFO:tasks.workunit.client.0.smithi012.stdout:test2 2023-08-23T01:02:14.902 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:02:14.902 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:14.902 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:02:14.945 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:02:14.946 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls -l 2023-08-23T01:02:14.946 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'test2.*2.*' 2023-08-23T01:02:15.000 INFO:tasks.workunit.client.0.smithi012.stdout:test2 1 MiB 2 2023-08-23T01:02:15.000 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv test2 --expires-at '3600 sec' 2023-08-23T01:02:15.106 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:15.106 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test2 2023-08-23T01:02:15.149 INFO:tasks.workunit.client.0.smithi012.stdout:225a825a10f9 test2 2023-08-23T01:02:15.149 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:15.150 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:15.150 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:02:15.190 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:02:15.190 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls -l 2023-08-23T01:02:15.191 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'test2.*USER.*protected until' 2023-08-23T01:02:15.253 INFO:tasks.workunit.client.0.smithi012.stdout:225a825a10f9 test2 USER Wed Aug 23 01:02:15 2023 protected until Wed Aug 23 02:02:15 2023 2023-08-23T01:02:15.254 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash rm 225a825a10f9 2023-08-23T01:02:15.254 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'Deferment time has not expired' 2023-08-23T01:02:15.293 INFO:tasks.workunit.client.0.smithi012.stdout:Deferment time has not expired, please use --force if you really want to remove the image 2023-08-23T01:02:15.294 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash rm --image-id 225a825a10f9 --force 2023-08-23T01:02:15.405 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:02:15.410 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 -s 1 test1 2023-08-23T01:02:15.482 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create test1@snap1 2023-08-23T01:02:15.921 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:15.934 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap protect test1@snap1 2023-08-23T01:02:15.998 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv test1 2023-08-23T01:02:16.100 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:16.100 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:02:16.139 INFO:tasks.workunit.client.0.smithi012.stdout:22b1dce284c0 test1 2023-08-23T01:02:16.139 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:16.140 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:16.140 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:02:16.173 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:02:16.174 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls -l 2023-08-23T01:02:16.174 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'test1.*USER.*' 2023-08-23T01:02:16.229 INFO:tasks.workunit.client.0.smithi012.stdout:22b1dce284c0 test1 USER Wed Aug 23 01:02:16 2023 expired at Wed Aug 23 01:02:16 2023 2023-08-23T01:02:16.229 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls -l 2023-08-23T01:02:16.230 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -v 'protected until' 2023-08-23T01:02:16.288 INFO:tasks.workunit.client.0.smithi012.stdout:ID NAME SOURCE DELETED_AT STATUS PARENT 2023-08-23T01:02:16.288 INFO:tasks.workunit.client.0.smithi012.stdout:22b1dce284c0 test1 USER Wed Aug 23 01:02:16 2023 expired at Wed Aug 23 01:02:16 2023 2023-08-23T01:02:16.289 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd trash ls 2023-08-23T01:02:16.289 INFO:tasks.workunit.client.0.smithi012.stderr:++ cut -d ' ' -f 1 2023-08-23T01:02:16.331 INFO:tasks.workunit.client.0.smithi012.stderr:+ ID=22b1dce284c0 2023-08-23T01:02:16.331 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap ls --image-id 22b1dce284c0 2023-08-23T01:02:16.332 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -v SNAPID 2023-08-23T01:02:16.332 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:16.332 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:02:16.389 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:02:16.389 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap ls --image-id 22b1dce284c0 2023-08-23T01:02:16.390 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '.*snap1.*' 2023-08-23T01:02:16.446 INFO:tasks.workunit.client.0.smithi012.stdout: 34 snap1 1 MiB yes Wed Aug 23 01:02:15 2023 2023-08-23T01:02:16.447 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap unprotect --image-id 22b1dce284c0 --snap snap1 2023-08-23T01:02:16.534 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm --image-id 22b1dce284c0 --snap snap1 2023-08-23T01:02:16.926 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:02:16.942 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -v SNAPID 2023-08-23T01:02:16.943 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:16.943 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap ls --image-id 22b1dce284c0 2023-08-23T01:02:16.943 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 0 2023-08-23T01:02:16.997 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:02:16.998 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash restore 22b1dce284c0 2023-08-23T01:02:17.057 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create test1@snap1 2023-08-23T01:02:17.943 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:17.959 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create test1@snap2 2023-08-23T01:02:18.951 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:18.970 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap ls --image-id 22b1dce284c0 2023-08-23T01:02:18.970 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -v SNAPID 2023-08-23T01:02:18.970 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:18.970 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 2 2023-08-23T01:02:19.025 INFO:tasks.workunit.client.0.smithi012.stdout:2 2023-08-23T01:02:19.025 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap purge --image-id 22b1dce284c0 2023-08-23T01:02:20.960 INFO:tasks.workunit.client.0.smithi012.stderr: Removing all snapshots: 50% complete... Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-08-23T01:02:20.975 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap ls --image-id 22b1dce284c0 2023-08-23T01:02:20.975 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -v SNAPID 2023-08-23T01:02:20.975 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:20.976 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 0 2023-08-23T01:02:21.027 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:02:21.027 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm --rbd_move_to_trash_on_remove=true --rbd_move_to_trash_on_remove_expire_seconds=3600 test1 2023-08-23T01:02:21.339 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:02:21.344 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:21.345 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:02:21.384 INFO:tasks.workunit.client.0.smithi012.stdout:22b1dce284c0 test1 2023-08-23T01:02:21.384 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:21.385 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:21.385 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:02:21.424 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:02:21.424 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls -l 2023-08-23T01:02:21.425 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'test1.*USER.*protected until' 2023-08-23T01:02:21.480 INFO:tasks.workunit.client.0.smithi012.stdout:22b1dce284c0 test1 USER Wed Aug 23 01:02:21 2023 protected until Wed Aug 23 02:02:21 2023 2023-08-23T01:02:21.481 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash rm 22b1dce284c0 2023-08-23T01:02:21.481 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'Deferment time has not expired' 2023-08-23T01:02:21.523 INFO:tasks.workunit.client.0.smithi012.stdout:Deferment time has not expired, please use --force if you 2023-08-23T01:02:21.513+0000 7ff908bc8340 -1 librbd::api::Trash: remove: error: deferment time has not expired. 2023-08-23T01:02:21.523 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash rm --image-id 22b1dce284c0 --force 2023-08-23T01:02:21.631 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:02:21.636 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:02:21.636 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:21.773 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:21.905 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:22.042 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:22.170 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:22.304 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:22.438 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:22.569 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:22.706 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:22.837 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:22.975 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:23.113 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:23.251 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:23.387 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:23.521 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:23.650 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:23.790 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:23.919 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:24.054 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_purge 2023-08-23T01:02:24.055 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing trash purge...' 2023-08-23T01:02:24.055 INFO:tasks.workunit.client.0.smithi012.stdout:testing trash purge... 2023-08-23T01:02:24.056 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:02:24.056 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:24.193 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:24.328 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:24.461 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:24.590 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:24.729 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:24.864 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:24.994 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:25.130 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:25.260 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:25.392 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:25.526 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:25.662 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:25.802 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:25.937 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:26.072 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:26.203 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:26.343 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:02:26.477 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:26.477 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:26.477 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 0 2023-08-23T01:02:26.520 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:02:26.520 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:26.554 INFO:tasks.workunit.client.0.smithi012.stderr: Removing images: 100% complete...done. 2023-08-23T01:02:26.558 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-08-23T01:02:26.643 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-08-23T01:02:26.709 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg1 2023-08-23T01:02:26.805 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg2 2023-08-23T01:02:26.912 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:26.912 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:26.912 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 2 2023-08-23T01:02:26.953 INFO:tasks.workunit.client.0.smithi012.stdout:2 2023-08-23T01:02:26.953 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:27.130 INFO:tasks.workunit.client.0.smithi012.stderr: Removing images: 50% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-08-23T01:02:27.262 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:27.263 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:27.263 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 0 2023-08-23T01:02:27.263 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:02:27.263 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-08-23T01:02:27.264 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-08-23T01:02:27.309 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg1 --expires-at '1 hour' 2023-08-23T01:02:27.415 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg2 --expires-at '3 hours' 2023-08-23T01:02:27.522 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:27.522 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 2 2023-08-23T01:02:27.522 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:27.560 INFO:tasks.workunit.client.0.smithi012.stdout:2 2023-08-23T01:02:27.561 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:27.597 INFO:tasks.workunit.client.0.smithi012.stderr: Removing images: 100% complete...done. 2023-08-23T01:02:27.598 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:27.599 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 2 2023-08-23T01:02:27.600 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:27.638 INFO:tasks.workunit.client.0.smithi012.stdout:2 2023-08-23T01:02:27.641 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge --expired-before 'now + 2 hours' 2023-08-23T01:02:27.747 INFO:tasks.workunit.client.0.smithi012.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-08-23T01:02:27.754 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:27.754 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:27.755 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:02:27.796 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:02:27.797 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:27.797 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg2 2023-08-23T01:02:27.835 INFO:tasks.workunit.client.0.smithi012.stdout:23f5d29d55c4 testimg2 2023-08-23T01:02:27.835 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge --expired-before 'now + 4 hours' 2023-08-23T01:02:27.960 INFO:tasks.workunit.client.0.smithi012.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-08-23T01:02:27.966 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:27.967 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:27.967 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 0 2023-08-23T01:02:28.004 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:02:28.004 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-08-23T01:02:28.071 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg1@snap 2023-08-23T01:02:28.938 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:28.955 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-08-23T01:02:29.026 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-08-23T01:02:29.098 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg1 2023-08-23T01:02:29.196 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg2 2023-08-23T01:02:29.303 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg3 2023-08-23T01:02:29.417 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:29.422 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:29.423 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 3 2023-08-23T01:02:29.454 INFO:tasks.workunit.client.0.smithi012.stdout:3 2023-08-23T01:02:29.456 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:29.457 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'some expired images could not be removed' 2023-08-23T01:02:29.737 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: some expired images could not be removed 2023-08-23T01:02:29.738 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:29.738 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:29.739 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:02:29.776 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:02:29.777 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:29.777 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg1 2023-08-23T01:02:29.815 INFO:tasks.workunit.client.0.smithi012.stdout:2416cff8b545 testimg1 2023-08-23T01:02:29.816 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd trash ls 2023-08-23T01:02:29.817 INFO:tasks.workunit.client.0.smithi012.stderr:++ awk '{ print $1 }' 2023-08-23T01:02:29.855 INFO:tasks.workunit.client.0.smithi012.stderr:+ ID=2416cff8b545 2023-08-23T01:02:29.855 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap purge --image-id 2416cff8b545 2023-08-23T01:02:30.937 INFO:tasks.workunit.client.0.smithi012.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-08-23T01:02:30.951 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:31.062 INFO:tasks.workunit.client.0.smithi012.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-08-23T01:02:31.066 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:31.067 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:31.067 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 0 2023-08-23T01:02:31.101 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:02:31.101 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-08-23T01:02:31.173 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-08-23T01:02:31.244 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg2@snap 2023-08-23T01:02:31.950 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:31.967 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-08-23T01:02:32.031 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg1 2023-08-23T01:02:32.131 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg2 2023-08-23T01:02:32.237 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg3 2023-08-23T01:02:32.345 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:32.345 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:32.346 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 3 2023-08-23T01:02:32.385 INFO:tasks.workunit.client.0.smithi012.stdout:3 2023-08-23T01:02:32.386 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'some expired images could not be removed' 2023-08-23T01:02:32.386 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:32.677 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: some expired images could not be removed 2023-08-23T01:02:32.678 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:32.678 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:32.679 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:02:32.720 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:02:32.721 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:32.721 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg2 2023-08-23T01:02:32.758 INFO:tasks.workunit.client.0.smithi012.stdout:2446be004212 testimg2 2023-08-23T01:02:32.759 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd trash ls 2023-08-23T01:02:32.760 INFO:tasks.workunit.client.0.smithi012.stderr:++ awk '{ print $1 }' 2023-08-23T01:02:32.803 INFO:tasks.workunit.client.0.smithi012.stderr:+ ID=2446be004212 2023-08-23T01:02:32.804 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap purge --image-id 2446be004212 2023-08-23T01:02:32.952 INFO:tasks.workunit.client.0.smithi012.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-08-23T01:02:32.965 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:33.069 INFO:tasks.workunit.client.0.smithi012.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-08-23T01:02:33.074 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:33.074 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:33.075 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 0 2023-08-23T01:02:33.113 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:02:33.114 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-08-23T01:02:33.182 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg2 2023-08-23T01:02:33.247 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-08-23T01:02:33.318 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg3@snap 2023-08-23T01:02:33.966 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:33.981 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg1 2023-08-23T01:02:34.099 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg2 2023-08-23T01:02:34.210 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg3 2023-08-23T01:02:34.320 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:34.321 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:34.321 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 3 2023-08-23T01:02:34.360 INFO:tasks.workunit.client.0.smithi012.stdout:3 2023-08-23T01:02:34.361 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:34.361 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'some expired images could not be removed' 2023-08-23T01:02:34.650 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: some expired images could not be removed 2023-08-23T01:02:34.651 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:34.651 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:34.652 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:02:34.691 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:02:34.692 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:34.692 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg3 2023-08-23T01:02:34.737 INFO:tasks.workunit.client.0.smithi012.stdout:247617826b5b testimg3 2023-08-23T01:02:34.738 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd trash ls 2023-08-23T01:02:34.738 INFO:tasks.workunit.client.0.smithi012.stderr:++ awk '{ print $1 }' 2023-08-23T01:02:34.781 INFO:tasks.workunit.client.0.smithi012.stderr:+ ID=247617826b5b 2023-08-23T01:02:34.781 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap purge --image-id 247617826b5b 2023-08-23T01:02:34.963 INFO:tasks.workunit.client.0.smithi012.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-08-23T01:02:34.977 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:35.087 INFO:tasks.workunit.client.0.smithi012.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-08-23T01:02:35.092 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:35.093 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:35.093 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 0 2023-08-23T01:02:35.132 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:02:35.132 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-08-23T01:02:35.202 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg1@snap 2023-08-23T01:02:35.934 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:35.948 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-08-23T01:02:36.071 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm testimg1@snap 2023-08-23T01:02:36.143 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:02:36.159 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-08-23T01:02:36.232 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg2@snap 2023-08-23T01:02:36.980 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:36.997 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-08-23T01:02:37.132 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-08-23T01:02:37.282 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm testimg2@snap 2023-08-23T01:02:37.364 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:02:37.381 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg4@snap 2023-08-23T01:02:37.982 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:37.998 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-08-23T01:02:38.148 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm testimg4@snap 2023-08-23T01:02:38.253 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:02:38.272 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg1 2023-08-23T01:02:38.387 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg2 2023-08-23T01:02:38.488 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg3 2023-08-23T01:02:38.586 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg4 2023-08-23T01:02:38.693 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:38.693 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:38.694 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 4 2023-08-23T01:02:38.737 INFO:tasks.workunit.client.0.smithi012.stdout:4 2023-08-23T01:02:38.738 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:38.738 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'some expired images could not be removed' 2023-08-23T01:02:39.177 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: some expired images could not be removed 2023-08-23T01:02:39.178 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:39.178 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:39.178 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 3 2023-08-23T01:02:39.218 INFO:tasks.workunit.client.0.smithi012.stdout:3 2023-08-23T01:02:39.219 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:39.219 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg1 2023-08-23T01:02:39.256 INFO:tasks.workunit.client.0.smithi012.stdout:249dbb5a7480 testimg1 2023-08-23T01:02:39.256 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:39.257 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg2 2023-08-23T01:02:39.296 INFO:tasks.workunit.client.0.smithi012.stdout:24a314646534 testimg2 2023-08-23T01:02:39.297 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:39.297 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg4 2023-08-23T01:02:39.335 INFO:tasks.workunit.client.0.smithi012.stdout:24afcf70c1c9 testimg4 2023-08-23T01:02:39.336 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg6 2023-08-23T01:02:39.444 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:39.444 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:39.445 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 4 2023-08-23T01:02:39.485 INFO:tasks.workunit.client.0.smithi012.stdout:4 2023-08-23T01:02:39.486 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:39.486 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'some expired images could not be removed' 2023-08-23T01:02:40.331 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: some expired images could not be removed 2023-08-23T01:02:40.332 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:40.332 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:40.332 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 2 2023-08-23T01:02:40.372 INFO:tasks.workunit.client.0.smithi012.stdout:2 2023-08-23T01:02:40.373 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:40.373 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg1 2023-08-23T01:02:40.413 INFO:tasks.workunit.client.0.smithi012.stdout:249dbb5a7480 testimg1 2023-08-23T01:02:40.414 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:40.414 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg2 2023-08-23T01:02:40.454 INFO:tasks.workunit.client.0.smithi012.stdout:24a314646534 testimg2 2023-08-23T01:02:40.455 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg5 2023-08-23T01:02:40.556 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:40.557 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:40.557 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 3 2023-08-23T01:02:40.598 INFO:tasks.workunit.client.0.smithi012.stdout:3 2023-08-23T01:02:40.599 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:40.779 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:02:40.773+0000 7fa167eac700 0 -- 172.21.15.12:0/3025336573 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7fa14004fae0 msgr2=0x7fa140051ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:02:40.811 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:02:40.805+0000 7fa1686ad700 0 -- 172.21.15.12:0/3025336573 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x55f4d76a3d00 msgr2=0x55f4d775ff30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:02:42.117 INFO:tasks.workunit.client.0.smithi012.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-08-23T01:02:42.122 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:42.123 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:42.123 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 0 2023-08-23T01:02:42.163 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:02:42.163 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-08-23T01:02:42.234 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg1@snap 2023-08-23T01:02:43.022 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:43.041 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-08-23T01:02:43.157 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm testimg1@snap 2023-08-23T01:02:43.230 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:02:43.248 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-08-23T01:02:43.316 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg3@snap 2023-08-23T01:02:44.026 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:44.044 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg2@snap 2023-08-23T01:02:45.049 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:45.067 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-08-23T01:02:45.197 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-08-23T01:02:45.333 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm testimg2@snap 2023-08-23T01:02:45.429 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:02:45.445 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg4@snap 2023-08-23T01:02:45.937 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:45.952 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-08-23T01:02:46.125 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm testimg4@snap 2023-08-23T01:02:46.234 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:02:46.253 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg1 2023-08-23T01:02:46.370 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg2 2023-08-23T01:02:46.478 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg3 2023-08-23T01:02:46.586 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg4 2023-08-23T01:02:46.699 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:46.700 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:46.700 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 4 2023-08-23T01:02:46.742 INFO:tasks.workunit.client.0.smithi012.stdout:4 2023-08-23T01:02:46.743 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'some expired images could not be removed' 2023-08-23T01:02:46.743 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:47.007 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: some expired images could not be removed 2023-08-23T01:02:47.008 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:47.009 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:47.009 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 4 2023-08-23T01:02:47.045 INFO:tasks.workunit.client.0.smithi012.stdout:4 2023-08-23T01:02:47.103 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg6 2023-08-23T01:02:47.154 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:47.154 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:47.154 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 5 2023-08-23T01:02:47.191 INFO:tasks.workunit.client.0.smithi012.stdout:5 2023-08-23T01:02:47.192 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:47.192 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'some expired images could not be removed' 2023-08-23T01:02:48.486 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: some expired images could not be removed 2023-08-23T01:02:48.486 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:48.487 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:48.487 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 3 2023-08-23T01:02:48.531 INFO:tasks.workunit.client.0.smithi012.stdout:3 2023-08-23T01:02:48.532 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:48.532 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg1 2023-08-23T01:02:48.571 INFO:tasks.workunit.client.0.smithi012.stdout:24fc9ed6dfb8 testimg1 2023-08-23T01:02:48.572 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:48.572 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg2 2023-08-23T01:02:48.613 INFO:tasks.workunit.client.0.smithi012.stdout:250244e956e7 testimg2 2023-08-23T01:02:48.614 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:48.614 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg3 2023-08-23T01:02:48.657 INFO:tasks.workunit.client.0.smithi012.stdout:250896d74c10 testimg3 2023-08-23T01:02:48.657 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg5 2023-08-23T01:02:48.763 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:48.764 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 4 2023-08-23T01:02:48.765 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:48.805 INFO:tasks.workunit.client.0.smithi012.stdout:4 2023-08-23T01:02:48.806 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:48.807 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'some expired images could not be removed' 2023-08-23T01:02:51.330 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: some expired images could not be removed 2023-08-23T01:02:51.330 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:51.331 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:51.331 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:02:51.373 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:02:51.373 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:51.374 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg3 2023-08-23T01:02:51.413 INFO:tasks.workunit.client.0.smithi012.stdout:250896d74c10 testimg3 2023-08-23T01:02:51.414 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd trash ls 2023-08-23T01:02:51.414 INFO:tasks.workunit.client.0.smithi012.stderr:++ awk '{ print $1 }' 2023-08-23T01:02:51.454 INFO:tasks.workunit.client.0.smithi012.stderr:+ ID=250896d74c10 2023-08-23T01:02:51.456 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap purge --image-id 250896d74c10 2023-08-23T01:02:52.059 INFO:tasks.workunit.client.0.smithi012.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-08-23T01:02:52.074 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:52.192 INFO:tasks.workunit.client.0.smithi012.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-08-23T01:02:52.199 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:52.199 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:52.199 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 0 2023-08-23T01:02:52.241 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:02:52.241 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-08-23T01:02:52.318 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg1@snap 2023-08-23T01:02:53.067 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:53.082 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-08-23T01:02:53.197 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm testimg1@snap 2023-08-23T01:02:53.268 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:02:53.286 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-08-23T01:02:53.361 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg2@snap 2023-08-23T01:02:54.080 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:54.095 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-08-23T01:02:54.234 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-08-23T01:02:54.374 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm testimg2@snap 2023-08-23T01:02:54.461 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:02:54.479 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg4@snap 2023-08-23T01:02:55.091 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:02:55.109 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-08-23T01:02:55.254 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm testimg4@snap 2023-08-23T01:02:55.362 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:02:55.386 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2023-08-23T01:02:55.530 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:02:55.534 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2023-08-23T01:02:55.678 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:02:55.682 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg3 2023-08-23T01:02:55.798 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2023-08-23T01:02:55.959 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:02:55.964 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:55.965 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:55.965 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 4 2023-08-23T01:02:56.001 INFO:tasks.workunit.client.0.smithi012.stdout:4 2023-08-23T01:02:56.002 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:56.002 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'some expired images could not be removed' 2023-08-23T01:02:56.439 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: some expired images could not be removed 2023-08-23T01:02:56.440 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:56.441 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:56.441 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 3 2023-08-23T01:02:56.481 INFO:tasks.workunit.client.0.smithi012.stdout:3 2023-08-23T01:02:56.482 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:56.482 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg1 2023-08-23T01:02:56.522 INFO:tasks.workunit.client.0.smithi012.stdout:25682493a6b6 testimg1 2023-08-23T01:02:56.523 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:56.523 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg2 2023-08-23T01:02:56.565 INFO:tasks.workunit.client.0.smithi012.stdout:256e8cb36b5e testimg2 2023-08-23T01:02:56.565 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:56.566 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg4 2023-08-23T01:02:56.605 INFO:tasks.workunit.client.0.smithi012.stdout:257ae96d27a9 testimg4 2023-08-23T01:02:56.606 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg6 2023-08-23T01:02:56.719 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:56.719 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:56.720 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 4 2023-08-23T01:02:56.757 INFO:tasks.workunit.client.0.smithi012.stdout:4 2023-08-23T01:02:56.758 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:56.758 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'some expired images could not be removed' 2023-08-23T01:02:58.143 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: some expired images could not be removed 2023-08-23T01:02:58.144 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:58.144 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:58.144 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 2 2023-08-23T01:02:58.184 INFO:tasks.workunit.client.0.smithi012.stdout:2 2023-08-23T01:02:58.185 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:58.185 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg1 2023-08-23T01:02:58.225 INFO:tasks.workunit.client.0.smithi012.stdout:25682493a6b6 testimg1 2023-08-23T01:02:58.226 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:58.227 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg2 2023-08-23T01:02:58.263 INFO:tasks.workunit.client.0.smithi012.stdout:256e8cb36b5e testimg2 2023-08-23T01:02:58.263 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg5 2023-08-23T01:02:58.377 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:02:58.378 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:02:58.378 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 3 2023-08-23T01:02:58.415 INFO:tasks.workunit.client.0.smithi012.stdout:3 2023-08-23T01:02:58.415 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:02:58.592 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:02:58.584+0000 7fea78a7a700 0 -- 172.21.15.12:0/1633200904 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7fea5004fae0 msgr2=0x7fea50051ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:02:58.618 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:02:58.612+0000 7fea7927b700 0 -- 172.21.15.12:0/1633200904 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x5609abc61c10 msgr2=0x5609abd05a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:00.083 INFO:tasks.workunit.client.0.smithi012.stderr: Removing images: 33% complete... Removing images: 66% complete... Removing images: 100% complete... Removing images: 100% complete...done. 2023-08-23T01:03:00.089 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:03:00.089 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:00.089 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 0 2023-08-23T01:03:00.125 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:03:00.126 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg1 2023-08-23T01:03:00.203 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg1@snap 2023-08-23T01:03:00.980 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:03:00.998 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg1@snap testimg2 2023-08-23T01:03:01.128 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm testimg1@snap 2023-08-23T01:03:01.206 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:03:01.224 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 256 testimg3 2023-08-23T01:03:01.300 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg3@snap 2023-08-23T01:03:01.984 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:03:01.999 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg2@snap 2023-08-23T01:03:02.998 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:03:03.014 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg4 2023-08-23T01:03:03.145 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg2@snap testimg5 2023-08-23T01:03:03.281 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm testimg2@snap 2023-08-23T01:03:03.362 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:03:03.381 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg4@snap 2023-08-23T01:03:04.000 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:03:04.019 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 testimg4@snap testimg6 2023-08-23T01:03:04.171 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm testimg4@snap 2023-08-23T01:03:04.271 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:03:04.289 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg1 2023-08-23T01:03:04.444 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:03:04.450 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg2 2023-08-23T01:03:04.606 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:03:04.610 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg3 2023-08-23T01:03:04.716 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm --rbd_move_parent_to_trash_on_remove=true testimg4 2023-08-23T01:03:04.858 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:03:04.864 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:03:04.864 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:04.864 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 4 2023-08-23T01:03:04.905 INFO:tasks.workunit.client.0.smithi012.stdout:4 2023-08-23T01:03:04.906 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:03:04.906 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'some expired images could not be removed' 2023-08-23T01:03:05.175 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: some expired images could not be removed 2023-08-23T01:03:05.176 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:03:05.176 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:05.176 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 4 2023-08-23T01:03:05.216 INFO:tasks.workunit.client.0.smithi012.stdout:4 2023-08-23T01:03:05.217 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg6 2023-08-23T01:03:05.331 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:03:05.331 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:05.331 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 5 2023-08-23T01:03:05.375 INFO:tasks.workunit.client.0.smithi012.stdout:5 2023-08-23T01:03:05.376 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:03:05.376 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'some expired images could not be removed' 2023-08-23T01:03:06.188 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: some expired images could not be removed 2023-08-23T01:03:06.189 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:03:06.189 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:06.189 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 3 2023-08-23T01:03:06.225 INFO:tasks.workunit.client.0.smithi012.stdout:3 2023-08-23T01:03:06.226 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:03:06.226 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg1 2023-08-23T01:03:06.268 INFO:tasks.workunit.client.0.smithi012.stdout:25c8aafe5f8c testimg1 2023-08-23T01:03:06.269 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:03:06.269 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg2 2023-08-23T01:03:06.308 INFO:tasks.workunit.client.0.smithi012.stdout:25cec4afa1e0 testimg2 2023-08-23T01:03:06.309 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:03:06.309 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg3 2023-08-23T01:03:06.348 INFO:tasks.workunit.client.0.smithi012.stdout:25d4d4d24d12 testimg3 2023-08-23T01:03:06.349 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash mv testimg5 2023-08-23T01:03:06.461 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:03:06.461 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:06.462 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 4 2023-08-23T01:03:06.502 INFO:tasks.workunit.client.0.smithi012.stdout:4 2023-08-23T01:03:06.503 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:03:06.503 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'some expired images could not be removed' 2023-08-23T01:03:08.114 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: some expired images could not be removed 2023-08-23T01:03:08.115 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:03:08.115 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:08.115 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:03:08.155 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:03:08.156 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:03:08.156 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep testimg3 2023-08-23T01:03:08.193 INFO:tasks.workunit.client.0.smithi012.stdout:25d4d4d24d12 testimg3 2023-08-23T01:03:08.194 INFO:tasks.workunit.client.0.smithi012.stderr:++ awk '{ print $1 }' 2023-08-23T01:03:08.194 INFO:tasks.workunit.client.0.smithi012.stderr:++ rbd trash ls 2023-08-23T01:03:08.239 INFO:tasks.workunit.client.0.smithi012.stderr:+ ID=25d4d4d24d12 2023-08-23T01:03:08.239 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap purge --image-id 25d4d4d24d12 2023-08-23T01:03:08.963 INFO:tasks.workunit.client.0.smithi012.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-08-23T01:03:08.978 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash purge 2023-08-23T01:03:09.086 INFO:tasks.workunit.client.0.smithi012.stderr: Removing images: 100% complete... Removing images: 100% complete...done. 2023-08-23T01:03:09.091 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:09.092 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 0 2023-08-23T01:03:09.092 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls 2023-08-23T01:03:09.132 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:03:09.132 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_deep_copy_clone 2023-08-23T01:03:09.133 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing deep copy clone...' 2023-08-23T01:03:09.133 INFO:tasks.workunit.client.0.smithi012.stdout:testing deep copy clone... 2023-08-23T01:03:09.133 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:03:09.134 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:09.264 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:09.405 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:09.541 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:09.678 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:09.821 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:09.960 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:10.101 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:10.435 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:10.569 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:10.702 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:10.842 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:10.978 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:11.106 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:11.246 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:11.391 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:11.537 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:11.672 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:11.810 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create testimg1 --image-format 2 --size 256 2023-08-23T01:03:11.883 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg1 --snap=snap1 2023-08-23T01:03:12.963 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:03:12.982 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap protect testimg1@snap1 2023-08-23T01:03:13.052 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone testimg1@snap1 testimg2 2023-08-23T01:03:13.172 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg2@snap2 2023-08-23T01:03:13.957 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:03:13.972 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd deep copy testimg2 testimg3 2023-08-23T01:03:14.944 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:03:14.936+0000 7f5101e73700 0 -- 172.21.15.12:0/1019108102 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f50e8008780 msgr2=0x7f50e800abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:14.979 INFO:tasks.workunit.client.0.smithi012.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete... Image deep copy: 4% complete... Image deep copy: 6% complete... Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-08-23T01:03:14.984 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg3 2023-08-23T01:03:14.985 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:03:15.059 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:03:15.060 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg3 2023-08-23T01:03:15.060 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'parent: rbd/testimg1@snap1' 2023-08-23T01:03:15.135 INFO:tasks.workunit.client.0.smithi012.stdout: parent: rbd/testimg1@snap1 2023-08-23T01:03:15.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap ls testimg3 2023-08-23T01:03:15.136 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -v SNAPID 2023-08-23T01:03:15.136 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:03:15.137 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:15.211 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:03:15.212 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap ls testimg3 2023-08-23T01:03:15.213 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '.*snap2.*' 2023-08-23T01:03:15.288 INFO:tasks.workunit.client.0.smithi012.stdout: 76 snap2 256 MiB Wed Aug 23 01:03:14 2023 2023-08-23T01:03:15.289 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg2 2023-08-23T01:03:15.289 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'features:.*deep-flatten' 2023-08-23T01:03:15.368 INFO:tasks.workunit.client.0.smithi012.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-08-23T01:03:15.369 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg3 2023-08-23T01:03:15.369 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'features:.*deep-flatten' 2023-08-23T01:03:15.445 INFO:tasks.workunit.client.0.smithi012.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-08-23T01:03:15.446 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd flatten testimg2 2023-08-23T01:03:15.543 INFO:tasks.workunit.client.0.smithi012.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-08-23T01:03:15.561 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd flatten testimg3 2023-08-23T01:03:15.657 INFO:tasks.workunit.client.0.smithi012.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-08-23T01:03:15.678 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap unprotect testimg1@snap1 2023-08-23T01:03:15.753 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap purge testimg2 2023-08-23T01:03:15.939 INFO:tasks.workunit.client.0.smithi012.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-08-23T01:03:15.954 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap purge testimg3 2023-08-23T01:03:16.965 INFO:tasks.workunit.client.0.smithi012.stderr: Removing all snapshots: 100% complete... Removing all snapshots: 100% complete...done. 2023-08-23T01:03:16.981 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm testimg2 2023-08-23T01:03:17.191 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete... Removing image: 100% complete...done. 2023-08-23T01:03:17.196 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm testimg3 2023-08-23T01:03:17.420 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 1% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 12% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 23% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 37% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 48% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 62% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 73% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 87% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 98% complete... Removing image: 100% complete...done. 2023-08-23T01:03:17.423 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap protect testimg1@snap1 2023-08-23T01:03:17.494 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone testimg1@snap1 testimg2 2023-08-23T01:03:17.615 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create testimg2@snap2 2023-08-23T01:03:17.972 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:03:17.990 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd deep copy --flatten testimg2 testimg3 2023-08-23T01:03:19.088 INFO:tasks.workunit.client.0.smithi012.stderr: Image deep copy: 1% complete... Image deep copy: 3% complete...2023-08-23T01:03:19.080+0000 7f0d4e175700 0 -- 172.21.15.12:0/388566615 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x561a1bcc6780 msgr2=0x561a1bdb2ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-08-23T01:03:19.191 INFO:tasks.workunit.client.0.smithi012.stderr: Image deep copy: 4% complete... Image deep copy: 6% complete...2023-08-23T01:03:19.184+0000 7f0d4e175700 0 -- 172.21.15.12:0/388566615 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f0d3405bbe0 msgr2=0x7f0d300393e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:19.784 INFO:tasks.workunit.client.0.smithi012.stderr: Image deep copy: 7% complete... Image deep copy: 9% complete... Image deep copy: 10% complete... Image deep copy: 12% complete... Image deep copy: 14% complete... Image deep copy: 15% complete... Image deep copy: 17% complete... Image deep copy: 18% complete... Image deep copy: 20% complete... Image deep copy: 21% complete... Image deep copy: 23% complete... Image deep copy: 25% complete... Image deep copy: 26% complete... Image deep copy: 28% complete... Image deep copy: 29% complete... Image deep copy: 31% complete... Image deep copy: 32% complete... Image deep copy: 34% complete... Image deep copy: 35% complete... Image deep copy: 37% complete... Image deep copy: 39% complete... Image deep copy: 40% complete... Image deep copy: 42% complete... Image deep copy: 43% complete... Image deep copy: 45% complete... Image deep copy: 46% complete... Image deep copy: 48% complete... Image deep copy: 50% complete... Image deep copy: 51% complete... Image deep copy: 53% complete... Image deep copy: 54% complete... Image deep copy: 56% complete... Image deep copy: 57% complete... Image deep copy: 59% complete... Image deep copy: 60% complete... Image deep copy: 62% complete... Image deep copy: 64% complete... Image deep copy: 65% complete... Image deep copy: 67% complete... Image deep copy: 68% complete... Image deep copy: 70% complete... Image deep copy: 71% complete... Image deep copy: 73% complete... Image deep copy: 75% complete... Image deep copy: 76% complete... Image deep copy: 78% complete... Image deep copy: 79% complete... Image deep copy: 81% complete... Image deep copy: 82% complete... Image deep copy: 84% complete... Image deep copy: 85% complete... Image deep copy: 87% complete... Image deep copy: 89% complete... Image deep copy: 90% complete... Image deep copy: 92% complete... Image deep copy: 93% complete... Image deep copy: 95% complete... Image deep copy: 96% complete... Image deep copy: 98% complete... Image deep copy: 100% complete... Image deep copy: 100% complete...done. 2023-08-23T01:03:19.790 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg3 2023-08-23T01:03:19.791 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'size 256 MiB' 2023-08-23T01:03:19.847 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:03:19.848 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg3 2023-08-23T01:03:19.848 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -v parent: 2023-08-23T01:03:19.906 INFO:tasks.workunit.client.0.smithi012.stdout:rbd image 'testimg3': 2023-08-23T01:03:19.906 INFO:tasks.workunit.client.0.smithi012.stdout: size 256 MiB in 64 objects 2023-08-23T01:03:19.906 INFO:tasks.workunit.client.0.smithi012.stdout: order 22 (4 MiB objects) 2023-08-23T01:03:19.906 INFO:tasks.workunit.client.0.smithi012.stdout: snapshot_count: 1 2023-08-23T01:03:19.907 INFO:tasks.workunit.client.0.smithi012.stdout: id: 26e1bf0f2359 2023-08-23T01:03:19.907 INFO:tasks.workunit.client.0.smithi012.stdout: block_name_prefix: rbd_data.26e1bf0f2359 2023-08-23T01:03:19.907 INFO:tasks.workunit.client.0.smithi012.stdout: format: 2 2023-08-23T01:03:19.907 INFO:tasks.workunit.client.0.smithi012.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-08-23T01:03:19.907 INFO:tasks.workunit.client.0.smithi012.stdout: op_features: 2023-08-23T01:03:19.907 INFO:tasks.workunit.client.0.smithi012.stdout: flags: 2023-08-23T01:03:19.907 INFO:tasks.workunit.client.0.smithi012.stdout: create_timestamp: Wed Aug 23 01:03:18 2023 2023-08-23T01:03:19.907 INFO:tasks.workunit.client.0.smithi012.stdout: access_timestamp: Wed Aug 23 01:03:18 2023 2023-08-23T01:03:19.908 INFO:tasks.workunit.client.0.smithi012.stdout: modify_timestamp: Wed Aug 23 01:03:18 2023 2023-08-23T01:03:19.908 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap ls testimg3 2023-08-23T01:03:19.908 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -v SNAPID 2023-08-23T01:03:19.909 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:19.909 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 1 2023-08-23T01:03:19.962 INFO:tasks.workunit.client.0.smithi012.stdout:1 2023-08-23T01:03:19.963 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap ls testimg3 2023-08-23T01:03:19.963 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '.*snap2.*' 2023-08-23T01:03:20.018 INFO:tasks.workunit.client.0.smithi012.stdout: 80 snap2 256 MiB Wed Aug 23 01:03:18 2023 2023-08-23T01:03:20.018 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd info testimg2 2023-08-23T01:03:20.019 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'features:.*deep-flatten' 2023-08-23T01:03:20.093 INFO:tasks.workunit.client.0.smithi012.stdout: features: layering, exclusive-lock, object-map, fast-diff, deep-flatten 2023-08-23T01:03:20.094 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd flatten testimg2 2023-08-23T01:03:20.188 INFO:tasks.workunit.client.0.smithi012.stderr: Image flatten: 1% complete... Image flatten: 3% complete... Image flatten: 4% complete... Image flatten: 6% complete... Image flatten: 7% complete... Image flatten: 9% complete... Image flatten: 10% complete... Image flatten: 12% complete... Image flatten: 14% complete... Image flatten: 15% complete... Image flatten: 17% complete... Image flatten: 18% complete... Image flatten: 20% complete... Image flatten: 21% complete... Image flatten: 23% complete... Image flatten: 25% complete... Image flatten: 26% complete... Image flatten: 28% complete... Image flatten: 29% complete... Image flatten: 31% complete... Image flatten: 32% complete... Image flatten: 34% complete... Image flatten: 35% complete... Image flatten: 37% complete... Image flatten: 39% complete... Image flatten: 40% complete... Image flatten: 42% complete... Image flatten: 43% complete... Image flatten: 45% complete... Image flatten: 46% complete... Image flatten: 48% complete... Image flatten: 50% complete... Image flatten: 51% complete... Image flatten: 53% complete... Image flatten: 54% complete... Image flatten: 56% complete... Image flatten: 57% complete... Image flatten: 59% complete... Image flatten: 60% complete... Image flatten: 62% complete... Image flatten: 64% complete... Image flatten: 65% complete... Image flatten: 67% complete... Image flatten: 68% complete... Image flatten: 70% complete... Image flatten: 71% complete... Image flatten: 73% complete... Image flatten: 75% complete... Image flatten: 76% complete... Image flatten: 78% complete... Image flatten: 79% complete... Image flatten: 81% complete... Image flatten: 82% complete... Image flatten: 84% complete... Image flatten: 85% complete... Image flatten: 87% complete... Image flatten: 89% complete... Image flatten: 90% complete... Image flatten: 92% complete... Image flatten: 93% complete... Image flatten: 95% complete... Image flatten: 96% complete... Image flatten: 98% complete... Image flatten: 100% complete...done. 2023-08-23T01:03:20.205 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap unprotect testimg1@snap1 2023-08-23T01:03:20.278 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:03:20.278 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:21.236 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:22.228 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:23.339 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:23.479 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:23.619 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:23.759 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:23.907 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:24.051 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:24.404 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:24.539 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:24.683 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:24.815 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:24.952 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:25.296 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:25.642 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:25.770 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:25.911 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:26.051 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_clone_v2 2023-08-23T01:03:26.051 INFO:tasks.workunit.client.0.smithi012.stdout:testing clone v2... 2023-08-23T01:03:26.051 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing clone v2...' 2023-08-23T01:03:26.052 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:03:26.052 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:26.186 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:26.325 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:26.673 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:26.809 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:26.951 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:27.096 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:27.235 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:27.365 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:27.510 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:27.651 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:27.788 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:27.927 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:28.067 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:28.206 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:28.342 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:28.479 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:28.618 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:28.755 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 -s 1 test1 2023-08-23T01:03:28.832 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create test1@1 2023-08-23T01:03:28.961 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:03:28.978 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test2 2023-08-23T01:03:29.040 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:03:29.032+0000 7f9e051ad700 -1 librbd::image::CloneRequest: 0x55c6a5bc0680 validate_parent: parent snapshot must be protected 2023-08-23T01:03:29.040 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: clone error: (22) Invalid argument 2023-08-23T01:03:29.045 INFO:tasks.workunit.client.0.smithi012.stderr:+ true 2023-08-23T01:03:29.045 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test2 2023-08-23T01:03:29.173 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=2 test1@1 test3 2023-08-23T01:03:29.504 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap protect test1@1 2023-08-23T01:03:29.580 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone --rbd-default-clone-format=1 test1@1 test4 2023-08-23T01:03:29.765 INFO:tasks.workunit.client.0.smithi012.stderr:+ sort 2023-08-23T01:03:29.766 INFO:tasks.workunit.client.0.smithi012.stderr:+ tr '\n' ' ' 2023-08-23T01:03:29.766 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd children test1@1 2023-08-23T01:03:29.766 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -E 'test2.*test3.*test4' 2023-08-23T01:03:29.838 INFO:tasks.workunit.client.0.smithi012.stdout:rbd/test2 rbd/test3 rbd/test4 2023-08-23T01:03:29.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ sort 2023-08-23T01:03:29.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ tr '\n' ' ' 2023-08-23T01:03:29.839 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -E 'test2.*test3.*test4' 2023-08-23T01:03:29.840 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd children --descendants test1 2023-08-23T01:03:29.940 INFO:tasks.workunit.client.0.smithi012.stdout:rbd/test2 rbd/test3 rbd/test4 2023-08-23T01:03:29.941 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd remove test4 2023-08-23T01:03:30.167 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:03:30.174 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap unprotect test1@1 2023-08-23T01:03:30.256 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap remove test1@1 2023-08-23T01:03:30.330 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:03:30.352 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap list --all test1 2023-08-23T01:03:30.353 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep -E 'trash \(1\) *$' 2023-08-23T01:03:30.410 INFO:tasks.workunit.client.0.smithi012.stdout: 84 b2b5f8ba-c20c-4a34-b54a-035ddf845464 1 MiB Wed Aug 23 01:03:28 2023 trash (1) 2023-08-23T01:03:30.411 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create test1@2 2023-08-23T01:03:30.974 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:03:30.991 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:03:30.991 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'image has snapshots' 2023-08-23T01:03:31.097 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: image has snapshots - these must be deleted with 'rbd snap purge' before the image can be removed. 2023-08-23T01:03:31.097 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm test1@2 2023-08-23T01:03:31.960 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:03:31.980 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:03:31.981 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'linked clones' 2023-08-23T01:03:32.089 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-08-23T01:03:32.090 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test3 2023-08-23T01:03:32.307 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:03:32.300+0000 7f14df02b700 0 -- 172.21.15.12:0/1027413683 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x561527b78c60 msgr2=0x561527c2bb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:32.318 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:03:32.324 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:03:32.325 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep 'linked clones' 2023-08-23T01:03:32.435 INFO:tasks.workunit.client.0.smithi012.stdout:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-08-23T01:03:32.435 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd flatten test2 2023-08-23T01:03:32.993 INFO:tasks.workunit.client.0.smithi012.stderr: Image flatten: 100% complete...done. 2023-08-23T01:03:33.009 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap list --all test1 2023-08-23T01:03:33.009 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:33.010 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:03:33.065 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:03:33.066 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:03:33.296 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:03:33.288+0000 7fc5b64eb700 0 -- 172.21.15.12:0/3103615982 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7fc59c012130 msgr2=0x7fc59c012550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:33.297 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:03:33.302 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:03:33.525 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:03:33.529 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 -s 1 test1 2023-08-23T01:03:33.598 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create test1@1 2023-08-23T01:03:33.988 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:03:34.008 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap create test1@2 2023-08-23T01:03:35.000 INFO:tasks.workunit.client.0.smithi012.stderr: Creating snap: 10% complete... Creating snap: 100% complete...done. 2023-08-23T01:03:35.017 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone test1@1 test2 --rbd-default-clone-format 2 2023-08-23T01:03:35.150 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd clone test1@2 test3 --rbd-default-clone-format 2 2023-08-23T01:03:35.264 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm test1@1 2023-08-23T01:03:35.340 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:03:35.359 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd snap rm test1@2 2023-08-23T01:03:35.437 INFO:tasks.workunit.client.0.smithi012.stderr: Removing snap: 100% complete...done. 2023-08-23T01:03:35.456 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd rm test1 2023-08-23T01:03:35.456 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:03:35.549 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:03:35.540+0000 7f067d30e340 -1 librbd::api::Image: remove: image has snapshots - not removing 2023-08-23T01:03:35.549 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 0% complete...failed. 2023-08-23T01:03:35.562 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: image has snapshots with linked clones - these must be deleted or flattened before the image can be removed. 2023-08-23T01:03:35.567 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:03:35.567 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 --rbd-move-parent-to-trash-on-remove=true 2023-08-23T01:03:35.718 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:03:35.723 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls -a 2023-08-23T01:03:35.723 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:03:35.761 INFO:tasks.workunit.client.0.smithi012.stdout:2817e54bf24b test1 2023-08-23T01:03:35.761 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test2 2023-08-23T01:03:35.972 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:03:35.964+0000 7f5be5716700 0 -- 172.21.15.12:0/2341671164 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x56493511a300 msgr2=0x5649351bbfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:36.993 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:03:36.988+0000 7f5be5716700 0 -- 172.21.15.12:0/2341671164 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7f5bc4033fd0 msgr2=0x7f5bc40363c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:37.050 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:03:37.055 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls -a 2023-08-23T01:03:37.056 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:03:37.097 INFO:tasks.workunit.client.0.smithi012.stdout:2817e54bf24b test1 2023-08-23T01:03:37.097 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test3 2023-08-23T01:03:37.309 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:03:37.296+0000 7fa0f11ef700 0 -- 172.21.15.12:0/3683038544 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x55a19cbf9060 msgr2=0x55a19cc9dfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:37.995 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:03:37.988+0000 7fa0f11ef700 0 -- 172.21.15.12:0/3683038544 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x7fa0d0034030 msgr2=0x7fa0d0036460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:38.088 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:03:38.093 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd trash ls -a 2023-08-23T01:03:38.094 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail grep test1 2023-08-23T01:03:38.094 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:03:38.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:03:38.135 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_thick_provision 2023-08-23T01:03:38.136 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing thick provision...' 2023-08-23T01:03:38.136 INFO:tasks.workunit.client.0.smithi012.stdout:testing thick provision... 2023-08-23T01:03:38.136 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:03:38.137 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:38.268 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:38.409 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:38.541 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:38.683 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:38.826 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:38.963 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:39.107 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:39.252 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:39.388 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:39.524 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:39.660 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:39.797 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:39.926 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:40.069 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:40.201 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:40.333 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:40.471 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:40.614 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --thick-provision -s 64M test1 2023-08-23T01:03:41.003 INFO:tasks.workunit.client.0.smithi012.stderr: Thick provisioning: 6% complete... Thick provisioning: 12% complete... Thick provisioning: 18% complete... Thick provisioning: 25% complete... Thick provisioning: 31% complete... Thick provisioning: 37% complete... Thick provisioning: 43% complete... Thick provisioning: 50% complete... Thick provisioning: 56% complete... Thick provisioning: 62% complete... Thick provisioning: 68% complete... Thick provisioning: 75% complete... Thick provisioning: 81% complete... Thick provisioning: 87% complete... Thick provisioning: 93% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-08-23T01:03:41.023 INFO:tasks.workunit.client.0.smithi012.stderr:+ count=0 2023-08-23T01:03:41.024 INFO:tasks.workunit.client.0.smithi012.stderr:+ ret= 2023-08-23T01:03:41.024 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 0 -lt 10 ']' 2023-08-23T01:03:41.024 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd du 2023-08-23T01:03:41.025 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:03:41.025 INFO:tasks.workunit.client.0.smithi012.stderr:+ cut -d ' ' -f 4-5 2023-08-23T01:03:41.025 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^64 MiB' 2023-08-23T01:03:41.025 INFO:tasks.workunit.client.0.smithi012.stderr:+ tr -s ' ' 2023-08-23T01:03:41.081 INFO:tasks.workunit.client.0.smithi012.stdout:64 MiB 2023-08-23T01:03:41.082 INFO:tasks.workunit.client.0.smithi012.stderr:+ ret=0 2023-08-23T01:03:41.083 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 0 = 0 ']' 2023-08-23T01:03:41.083 INFO:tasks.workunit.client.0.smithi012.stderr:+ break 2023-08-23T01:03:41.083 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd du 2023-08-23T01:03:41.136 INFO:tasks.workunit.client.0.smithi012.stdout:NAME PROVISIONED USED 2023-08-23T01:03:41.136 INFO:tasks.workunit.client.0.smithi012.stdout:test1 64 MiB 64 MiB 2023-08-23T01:03:41.140 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 0 '!=' 0 ']' 2023-08-23T01:03:41.140 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:03:41.389 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 6% complete... Removing image: 12% complete... Removing image: 18% complete... Removing image: 25% complete... Removing image: 31% complete... Removing image: 37% complete... Removing image: 43% complete... Removing image: 50% complete... Removing image: 56% complete... Removing image: 62% complete... Removing image: 68% complete... Removing image: 75% complete... Removing image: 81% complete... Removing image: 87% complete... Removing image: 93% complete...2023-08-23T01:03:41.383+0000 7f8e0aeb6700 0 -- 172.21.15.12:0/2903597993 >> [v2:172.21.15.12:6808/29703,v1:172.21.15.12:6809/29703] conn(0x558507459300 msgr2=0x5585074fa0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:41.429 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 100% complete...done. 2023-08-23T01:03:41.433 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:03:41.433 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:41.434 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:03:41.434 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:03:41.471 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:03:41.471 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --thick-provision -s 4G test1 2023-08-23T01:03:42.069 INFO:tasks.workunit.client.0.smithi012.stderr: Thick provisioning: 1% complete... Thick provisioning: 2% complete... Thick provisioning: 3% complete... Thick provisioning: 4% complete... Thick provisioning: 5% complete...2023-08-23T01:03:42.063+0000 7f1511313700 0 -- 172.21.15.12:0/469117207 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x5581d1805300 msgr2=0x5581d17f7b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:42.184 INFO:tasks.workunit.client.0.smithi012.stderr: Thick provisioning: 6% complete...2023-08-23T01:03:42.175+0000 7f1511313700 0 -- 172.21.15.12:0/469117207 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f14f4033e70 msgr2=0x7f14f40362a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:52.914 INFO:tasks.workunit.client.0.smithi012.stderr: Thick provisioning: 7% complete... Thick provisioning: 8% complete... Thick provisioning: 9% complete... Thick provisioning: 10% complete... Thick provisioning: 11% complete... Thick provisioning: 12% complete... Thick provisioning: 13% complete... Thick provisioning: 14% complete... Thick provisioning: 15% complete... Thick provisioning: 16% complete... Thick provisioning: 17% complete... Thick provisioning: 18% complete... Thick provisioning: 19% complete... Thick provisioning: 20% complete... Thick provisioning: 21% complete... Thick provisioning: 22% complete... Thick provisioning: 23% complete... Thick provisioning: 24% complete... Thick provisioning: 25% complete... Thick provisioning: 26% complete... Thick provisioning: 27% complete... Thick provisioning: 28% complete... Thick provisioning: 29% complete... Thick provisioning: 30% complete... Thick provisioning: 31% complete... Thick provisioning: 32% complete... Thick provisioning: 33% complete... Thick provisioning: 34% complete... Thick provisioning: 35% complete... Thick provisioning: 36% complete... Thick provisioning: 37% complete... Thick provisioning: 38% complete... Thick provisioning: 39% complete... Thick provisioning: 40% complete... Thick provisioning: 41% complete... Thick provisioning: 42% complete... Thick provisioning: 43% complete... Thick provisioning: 44% complete... Thick provisioning: 45% complete... Thick provisioning: 46% complete... Thick provisioning: 47% complete... Thick provisioning: 48% complete... Thick provisioning: 49% complete... Thick provisioning: 50% complete... Thick provisioning: 51% complete... Thick provisioning: 52% complete... Thick provisioning: 53% complete... Thick provisioning: 54% complete... Thick provisioning: 55% complete... Thick provisioning: 56% complete... Thick provisioning: 57% complete... Thick provisioning: 58% complete... Thick provisioning: 59% complete... Thick provisioning: 60% complete... Thick provisioning: 61% complete... Thick provisioning: 62% complete... Thick provisioning: 63% complete... Thick provisioning: 64% complete... Thick provisioning: 65% complete... Thick provisioning: 66% complete... Thick provisioning: 67% complete... Thick provisioning: 68% complete... Thick provisioning: 69% complete... Thick provisioning: 70% complete... Thick provisioning: 71% complete... Thick provisioning: 72% complete... Thick provisioning: 73% complete... Thick provisioning: 74% complete... Thick provisioning: 75% complete... Thick provisioning: 76% complete... Thick provisioning: 77% complete... Thick provisioning: 78% complete... Thick provisioning: 79% complete... Thick provisioning: 80% complete... Thick provisioning: 81% complete... Thick provisioning: 82% complete... Thick provisioning: 83% complete... Thick provisioning: 84% complete... Thick provisioning: 85% complete... Thick provisioning: 86% complete... Thick provisioning: 87% complete... Thick provisioning: 88% complete... Thick provisioning: 89% complete... Thick provisioning: 90% complete... Thick provisioning: 91% complete... Thick provisioning: 92% complete... Thick provisioning: 93% complete... Thick provisioning: 94% complete... Thick provisioning: 95% complete... Thick provisioning: 96% complete... Thick provisioning: 97% complete... Thick provisioning: 98% complete... Thick provisioning: 99% complete... Thick provisioning: 100% complete... Thick provisioning: 100% complete...done. 2023-08-23T01:03:52.930 INFO:tasks.workunit.client.0.smithi012.stderr:+ count=0 2023-08-23T01:03:52.930 INFO:tasks.workunit.client.0.smithi012.stderr:+ ret= 2023-08-23T01:03:52.931 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 0 -lt 10 ']' 2023-08-23T01:03:52.931 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd du 2023-08-23T01:03:52.931 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:03:52.932 INFO:tasks.workunit.client.0.smithi012.stderr:+ tr -s ' ' 2023-08-23T01:03:52.932 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^4 GiB' 2023-08-23T01:03:52.932 INFO:tasks.workunit.client.0.smithi012.stderr:+ cut -d ' ' -f 4-5 2023-08-23T01:03:52.989 INFO:tasks.workunit.client.0.smithi012.stdout:4 GiB 2023-08-23T01:03:52.990 INFO:tasks.workunit.client.0.smithi012.stderr:+ ret=0 2023-08-23T01:03:52.990 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 0 = 0 ']' 2023-08-23T01:03:52.990 INFO:tasks.workunit.client.0.smithi012.stderr:+ break 2023-08-23T01:03:52.990 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd du 2023-08-23T01:03:53.048 INFO:tasks.workunit.client.0.smithi012.stdout:NAME PROVISIONED USED 2023-08-23T01:03:53.048 INFO:tasks.workunit.client.0.smithi012.stdout:test1 4 GiB 4 GiB 2023-08-23T01:03:53.053 INFO:tasks.workunit.client.0.smithi012.stderr:+ '[' 0 '!=' 0 ']' 2023-08-23T01:03:53.053 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd rm test1 2023-08-23T01:03:53.275 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 1% complete... Removing image: 2% complete...2023-08-23T01:03:53.267+0000 7fb11bcc8700 0 -- 172.21.15.12:0/1025164840 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7fb0f4008780 msgr2=0x7fb0f400abd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:53.301 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 3% complete... Removing image: 4% complete...2023-08-23T01:03:53.295+0000 7fb11bcc8700 0 -- 172.21.15.12:0/1025164840 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7fb100033e60 msgr2=0x7fb100036290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:54.396 INFO:tasks.workunit.client.0.smithi012.stderr: Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2023-08-23T01:03:54.400 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd ls 2023-08-23T01:03:54.400 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test1 2023-08-23T01:03:54.400 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:54.401 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:03:54.439 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:03:54.440 INFO:tasks.workunit.client.0.smithi012.stderr:+ test_namespace 2023-08-23T01:03:54.440 INFO:tasks.workunit.client.0.smithi012.stderr:+ echo 'testing namespace...' 2023-08-23T01:03:54.441 INFO:tasks.workunit.client.0.smithi012.stdout:testing namespace... 2023-08-23T01:03:54.442 INFO:tasks.workunit.client.0.smithi012.stderr:+ remove_images 2023-08-23T01:03:54.442 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:54.571 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:54.703 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:54.837 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:54.980 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:55.107 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:55.246 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:55.390 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:55.528 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:55.666 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:55.805 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:55.947 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:56.090 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:56.231 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:56.366 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:56.507 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:56.649 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:56.792 INFO:tasks.workunit.client.0.smithi012.stderr:+ for img in $IMGS 2023-08-23T01:03:57.148 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd namespace ls 2023-08-23T01:03:57.148 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:57.149 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^0$' 2023-08-23T01:03:57.190 INFO:tasks.workunit.client.0.smithi012.stdout:0 2023-08-23T01:03:57.191 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd namespace create rbd/test1 2023-08-23T01:03:57.246 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd namespace create --pool rbd --namespace test2 2023-08-23T01:03:57.300 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd namespace create --namespace test3 2023-08-23T01:03:57.351 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd namespace create rbd/test3 2023-08-23T01:03:57.351 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd namespace create rbd/test3 2023-08-23T01:03:57.396 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:03:57.387+0000 7fdde1ca5340 -1 librbd::api::Namespace: create: failed to add namespace: (17) File exists 2023-08-23T01:03:57.397 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: failed to created namespace: (17) File exists 2023-08-23T01:03:57.401 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:03:57.402 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd namespace list 2023-08-23T01:03:57.402 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep test 2023-08-23T01:03:57.403 INFO:tasks.workunit.client.0.smithi012.stderr:+ wc -l 2023-08-23T01:03:57.403 INFO:tasks.workunit.client.0.smithi012.stderr:+ grep '^3$' 2023-08-23T01:03:57.442 INFO:tasks.workunit.client.0.smithi012.stdout:3 2023-08-23T01:03:57.443 INFO:tasks.workunit.client.0.smithi012.stderr:+ expect_fail rbd namespace remove --pool rbd missing 2023-08-23T01:03:57.443 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd namespace remove --pool rbd missing 2023-08-23T01:03:57.468 INFO:tasks.workunit.client.0.smithi012.stderr:rbd: namespace name was not specified 2023-08-23T01:03:57.470 INFO:tasks.workunit.client.0.smithi012.stderr:+ return 0 2023-08-23T01:03:57.472 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd create --image-format 2 --size 1G rbd/test1/image1 2023-08-23T01:03:57.554 INFO:tasks.workunit.client.0.smithi012.stderr:+ rbd bench --io-type write --io-pattern rand --io-total 32M --io-size 4K rbd/test1/image1 2023-08-23T01:03:57.637 INFO:tasks.workunit.client.0.smithi012.stdout:bench type write io_size 4096 io_threads 16 bytes 33554432 pattern random 2023-08-23T01:03:58.765 INFO:tasks.workunit.client.0.smithi012.stdout: SEC OPS OPS/SEC BYTES/SEC 2023-08-23T01:03:58.766 INFO:tasks.workunit.client.0.smithi012.stdout: 1 2928 2619.28 10 MiB/s 2023-08-23T01:03:59.567 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:03:59.559+0000 7f19ac96b700 0 -- 172.21.15.12:0/2562084688 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x7f198c033e60 msgr2=0x7f198c036290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2023-08-23T01:03:59.710 INFO:tasks.workunit.client.0.smithi012.stdout: 2 4288 2081.28 8.1 MiB/s 2023-08-23T01:04:00.650 INFO:tasks.workunit.client.0.smithi012.stdout: 3 4576 1526.63 6.0 MiB/s 2023-08-23T01:04:00.883 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:04:00.875+0000 7f19ac96b700 0 -- 172.21.15.12:0/2562084688 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x55b0d5339730 msgr2=0x7f198c12c0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-08-23T01:04:31.604 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:31.594+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:31.730 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:31.718+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:32.581 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:32.570+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:32.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:32.770+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:33.577 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:33.566+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:33.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:33.802+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:34.550 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:34.542+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:34.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:34.818+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:35.548 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:35.538+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:35.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:35.814+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:36.532 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:36.522+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:36.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:36.802+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:37.534 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:37.526+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:37.792 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:37.782+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:38.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:38.518+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:38.818 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:38.810+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:39.533 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:39.522+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:39.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:39.818+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:40.501 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:40.490+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:40.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:40.818+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:41.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:41.490+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:41.874 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:41.866+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:42.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:42.530+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:42.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:42.826+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:43.582 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:43.574+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:43.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:43.842+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:44.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:44.526+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:44.838 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:44.830+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:45.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:45.518+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:45.841 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:45.830+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:46.548 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:46.538+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:46.877 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:46.866+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:47.549 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:47.538+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:47.878 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:47.870+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:48.521 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:48.510+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:48.909 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:48.898+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:49.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:49.530+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:49.865 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:49.854+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:50.552 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:50.542+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:50.897 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:50.886+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:51.555 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:51.546+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:51.937 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:51.926+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:52.518 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:52.506+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:52.898 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:52.886+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:53.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:53.458+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:53.896 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:53.886+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:54.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:54.430+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:54.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:54.926+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:55.435 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:55.426+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:55.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:55.914+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:56.458 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:56.450+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:56.898 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:56.886+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:57.415 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:57.406+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:57.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:57.918+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:58.367 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:58.358+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:58.901 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:58.890+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:04:59.407 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:04:59.398+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:04:59.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:04:59.842+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:00.385 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:00.374+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:00.885 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:00.874+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:01.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:01.366+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:01.900 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:01.890+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:02.340 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:02.330+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:02.937 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:02.926+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:03.333 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:03.322+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:03.924 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:03.914+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:04.290 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:04.278+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:04.927 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:04.918+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:05.327 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:05.318+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:05.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:05.970+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:06.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:06.302+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:06.935 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:06.926+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:07.285 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:07.274+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:07.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:07.886+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:08.315 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:08.305+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:08.861 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:08.849+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:09.286 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:09.273+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:09.861 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:09.849+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:10.322 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:10.313+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:10.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:10.881+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:11.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:11.317+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:11.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:11.841+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:12.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:12.289+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:12.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:12.865+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:13.334 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:13.325+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:13.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:13.913+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:14.326 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:14.317+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:14.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:14.957+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:15.293 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:15.285+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:15.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:15.965+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:16.329 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:16.321+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:16.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:16.965+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:17.305 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:17.297+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:18.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:18.005+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:18.260 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:18.253+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:19.061 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:19.053+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:19.260 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:19.253+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:20.109 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:20.101+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:20.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:20.305+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:21.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:21.077+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:21.330 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:21.325+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:22.066 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:22.057+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:22.318 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:22.313+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:23.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:23.065+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:23.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:23.353+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:24.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:24.105+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:24.321 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:24.313+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:25.122 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:25.117+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:25.321 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:25.313+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:26.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:26.137+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:26.275 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:26.269+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:27.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:27.185+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:27.324 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:27.313+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:28.214 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:28.209+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:28.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:28.353+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:29.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:29.181+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:29.354 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:29.345+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:30.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:30.137+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:30.395 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:30.389+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:31.177 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:31.169+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:31.382 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:31.373+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:32.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:32.173+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:32.431 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:32.409+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:33.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:33.177+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:33.393 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:33.385+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:34.231 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:34.225+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:34.376 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:34.369+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:35.256 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:35.249+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:35.336 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:35.329+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:36.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:36.245+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:36.318 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:36.309+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:37.274 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:37.265+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:37.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:37.341+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:38.289 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:38.281+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:38.332 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:38.325+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:39.301 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:39.293+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:39.304 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:39.297+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:40.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:40.325+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:40.352 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:40.345+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:41.300 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:41.293+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:41.386 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:41.377+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:42.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:42.317+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:42.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:42.373+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:43.342 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:43.333+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:43.343 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:43.337+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:44.311 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:44.305+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:44.371 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:44.365+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:45.282 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:45.273+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:45.406 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:45.397+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:46.266 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:46.257+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:46.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:46.365+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:47.297 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:47.285+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:47.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:47.345+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:48.337 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:48.325+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:48.403 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:48.397+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:49.288 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:49.277+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:49.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:49.401+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:50.239 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:50.233+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:50.423 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:50.413+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:51.207 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:51.197+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:51.462 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:51.453+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:52.215 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:52.209+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:52.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:52.445+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:53.218 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:53.196+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:53.460 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:53.452+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:54.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:54.244+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:54.433 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:54.424+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:55.279 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:55.268+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:55.444 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:55.436+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:56.269 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:56.260+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:56.429 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:56.420+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:57.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:57.288+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:57.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:57.432+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:58.252 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:58.244+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:58.481 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:58.472+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:05:59.250 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:05:59.240+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:05:59.448 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:05:59.440+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:00.289 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:00.280+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:00.492 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:00.484+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:01.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:01.296+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:01.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:01.444+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:02.327 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:02.320+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:02.410 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:02.400+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:03.321 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:03.312+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:03.376 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:03.368+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:04.355 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:04.348+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:04.367 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:04.360+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:05.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:05.336+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:05.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:05.364+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:06.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:06.376+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:06.399 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:06.388+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:07.340 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:07.328+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:07.383 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:07.372+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:08.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:08.300+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:08.404 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:08.392+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:09.351 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:09.344+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:09.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:09.392+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:10.407 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:10.392+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:10.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:10.400+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:11.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:11.344+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:11.414 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:11.404+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:12.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:12.372+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:12.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:12.376+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:13.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:13.356+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:13.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:13.412+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:14.396 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:14.380+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:14.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:14.412+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:15.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:15.364+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:15.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:15.376+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:16.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:16.368+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:16.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:16.380+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:17.389 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:17.368+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:17.398 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:17.388+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:18.418 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:18.408+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:18.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:18.412+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:19.377 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:19.368+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:19.444 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:19.432+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:20.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:20.416+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:20.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:20.472+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:21.434 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:21.424+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:21.438 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:21.428+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:22.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:22.408+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:22.489 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:22.476+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:23.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:23.376+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:23.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:23.476+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:24.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:24.352+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:24.502 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:24.492+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:25.396 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:25.388+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:25.511 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:25.500+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:26.397 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:26.380+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:26.562 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:26.552+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:27.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:27.428+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:27.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:27.508+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:28.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:28.392+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:28.511 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:28.500+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:29.368 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:29.356+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:29.488 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:29.480+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:30.395 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:30.384+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:30.533 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:30.524+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:31.446 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:31.436+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:31.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:31.508+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:32.488 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:32.476+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:32.489 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:32.480+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:33.458 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:33.448+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:33.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:33.460+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:34.434 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:34.416+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:34.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:34.448+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:35.427 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:35.412+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:35.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:35.432+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:36.410 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:36.400+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:36.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:36.412+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:37.433 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:37.423+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:37.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:37.455+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:38.479 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:38.467+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:38.502 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:38.491+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:39.489 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:39.471+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:39.529 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:39.519+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:40.484 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:40.475+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:40.543 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:40.531+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:41.489 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:41.479+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:41.572 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:41.563+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:42.524 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:42.515+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:42.563 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:42.551+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:43.545 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:43.531+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:43.590 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:43.579+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:44.516 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:44.507+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:44.544 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:44.531+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:45.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:45.503+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:45.552 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:45.535+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:46.502 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:46.491+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:46.508 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:46.499+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:47.475 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:47.451+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:47.543 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:47.531+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:48.417 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:48.403+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:48.584 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:48.571+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:49.375 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:49.363+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:49.601 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:49.587+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:50.329 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:50.319+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:50.624 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:50.615+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:51.354 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:51.343+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:51.631 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:51.615+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:52.367 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:52.355+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:52.584 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:52.571+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:53.357 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:53.335+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:53.612 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:53.603+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:54.301 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:54.291+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:54.630 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:54.619+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:55.312 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:55.303+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:55.614 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:55.603+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:56.296 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:56.283+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:56.638 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:56.627+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:57.322 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:57.311+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:57.659 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:57.647+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:58.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:58.355+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:58.629 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:58.611+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:06:59.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:06:59.371+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:06:59.637 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:06:59.627+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:00.432 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:00.411+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:00.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:00.591+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:01.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:01.423+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:01.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:01.603+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:02.422 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:02.411+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:02.572 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:02.559+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:03.472 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:03.455+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:03.544 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:03.535+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:04.425 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:04.415+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:04.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:04.539+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:05.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:05.455+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:05.522 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:05.511+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:06.435 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:06.423+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:06.538 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:06.523+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:07.428 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:07.415+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:07.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:07.503+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:08.429 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:08.419+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:08.553 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:08.543+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:09.426 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:09.415+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:09.597 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:09.583+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:10.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:10.447+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:10.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:10.615+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:11.423 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:11.411+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:11.658 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:11.639+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:12.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:12.439+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:12.665 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:12.647+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:13.443 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:13.431+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:13.627 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:13.615+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:14.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:14.391+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:14.583 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:14.571+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:15.377 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:15.363+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:15.546 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:15.535+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:16.347 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:16.331+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:16.510 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:16.495+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:17.383 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:17.371+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:17.521 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:17.507+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:18.375 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:18.363+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:18.490 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:18.479+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:19.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:19.343+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:19.534 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:19.511+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:20.376 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:20.363+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:20.558 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:20.547+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:21.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:21.314+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:21.545 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:21.530+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:22.292 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:22.282+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:22.541 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:22.526+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:23.275 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:23.262+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:23.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:23.578+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:24.314 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:24.302+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:24.574 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:24.558+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:25.273 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:25.254+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:25.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:25.526+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:26.248 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:26.238+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:26.559 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:26.546+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:27.275 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:27.262+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:27.611 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:27.594+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:28.313 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:28.302+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:28.568 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:28.558+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:29.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:29.330+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:29.619 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:29.606+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:30.336 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:30.322+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:30.598 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:30.586+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:31.292 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:31.282+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:31.568 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:31.558+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:32.325 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:32.314+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:32.591 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:32.578+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:33.284 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:33.270+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:33.611 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:33.598+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:34.267 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:34.254+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:34.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:34.582+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:35.268 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:35.258+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:35.561 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:35.550+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:36.310 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:36.298+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:36.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:36.506+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:37.342 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:37.330+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:37.493 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:37.482+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:38.316 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:38.302+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:38.474 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:38.462+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:39.365 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:39.350+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:39.485 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:39.474+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:40.358 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:40.346+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:40.492 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:40.482+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:41.326 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:41.314+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:41.461 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:41.450+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:42.332 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:42.318+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:42.510 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:42.498+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:43.380 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:43.362+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:43.528 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:43.518+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:44.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:44.322+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:44.572 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:44.558+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:45.376 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:45.366+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:45.571 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:45.558+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:46.389 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:46.374+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:46.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:46.526+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:47.376 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:47.366+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:47.516 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:47.502+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:48.408 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:48.394+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:48.528 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:48.514+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:49.448 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:49.438+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:49.555 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:49.542+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:50.476 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:50.466+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:50.542 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:50.530+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:51.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:51.486+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:51.584 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:51.574+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:52.510 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:52.498+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:52.593 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:52.582+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:53.509 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:53.494+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:53.572 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:53.562+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:54.510 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:54.498+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:54.600 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:54.586+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:55.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:55.514+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:55.630 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:55.618+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:56.505 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:56.494+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:56.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:56.590+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:57.522 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:57.510+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:57.584 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:57.570+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:58.482 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:58.470+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:58.578 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:58.566+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:07:59.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:07:59.442+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:07:59.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:07:59.586+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:00.438 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:00.426+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:00.549 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:00.538+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:01.482 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:01.470+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:01.595 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:01.582+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:02.517 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:02.502+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:02.572 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:02.558+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:03.534 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:03.522+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:03.544 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:03.534+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:04.497 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:04.482+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:04.549 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:04.538+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:05.479 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:05.466+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:05.515 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:05.498+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:06.434 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:06.422+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:06.523 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:06.502+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:07.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:07.442+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:07.494 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:07.482+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:08.491 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:08.478+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:08.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:08.486+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:09.471 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:09.458+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:09.528 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:09.518+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:10.482 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:10.470+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:10.571 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:10.558+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:11.519 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:11.506+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:11.525 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:11.514+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:12.496 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:12.486+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:12.564 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:12.550+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:13.469 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:13.454+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:13.544 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:13.534+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:14.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:14.422+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:14.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:14.486+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:15.415 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:15.402+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:15.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:15.514+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:16.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:16.370+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:16.481 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:16.466+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:17.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:17.362+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:17.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:17.462+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:18.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:18.378+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:18.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:18.426+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:19.379 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:19.366+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:19.397 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:19.386+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:20.404 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:20.390+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:20.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:20.394+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:21.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:21.370+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:21.400 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:21.386+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:22.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:22.342+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:22.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:22.346+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:23.322 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:23.306+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:23.363 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:23.350+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:24.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:24.334+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:24.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:24.374+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:25.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:25.338+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:25.368 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:25.354+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:26.333 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:26.318+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:26.345 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:26.334+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:27.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:27.322+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:27.374 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:27.362+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:28.327 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:28.314+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:28.350 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:28.338+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:29.327 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:29.314+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:29.355 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:29.342+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:30.281 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:30.270+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:30.324 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:30.314+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:31.302 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:31.290+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:31.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:31.334+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:32.314 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:32.302+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:32.332 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:32.322+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:33.304 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:33.294+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:33.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:33.346+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:34.289 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:34.278+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:34.396 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:34.382+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:35.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:35.302+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:35.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:35.430+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:36.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:36.346+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:36.417 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:36.398+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:37.355 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:37.342+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:37.371 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:37.358+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:38.334 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:38.322+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:38.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:38.386+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:39.357 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:39.346+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:39.389 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:39.378+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:40.406 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:40.394+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:40.407 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:40.394+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:41.394 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:41.382+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:41.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:41.382+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:42.429 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:42.418+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:42.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:42.422+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:43.386 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:43.374+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:43.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:43.426+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:44.428 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:44.414+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:44.453 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:44.442+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:45.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:45.370+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:45.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:45.430+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:46.340 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:46.330+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:46.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:46.422+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:47.301 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:47.290+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:47.487 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:47.474+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:48.293 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:48.278+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:48.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:48.514+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:49.280 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:49.266+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:49.567 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:49.554+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:50.283 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:50.270+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:50.557 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:50.542+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:51.292 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:51.282+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:51.567 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:51.554+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:52.280 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:52.262+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:52.532 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:52.518+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:53.255 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:53.242+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:53.523 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:53.510+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:54.221 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:54.202+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:54.506 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:54.494+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:55.168 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:55.154+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:55.514 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:55.502+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:56.215 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:56.198+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:56.521 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:56.506+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:57.168 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:57.154+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:57.514 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:57.502+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:58.212 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:58.198+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:58.522 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:58.510+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:08:59.221 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:08:59.210+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:08:59.475 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:08:59.462+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:00.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:00.214+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:00.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:00.514+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:01.208 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:01.194+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:01.496 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:01.486+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:02.181 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:02.166+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:02.496 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:02.482+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:03.214 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:03.202+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:03.532 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:03.518+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:04.221 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:04.205+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:04.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:04.501+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:05.174 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:05.161+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:05.524 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:05.513+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:06.126 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:06.113+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:06.501 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:06.489+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:07.107 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:07.093+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:07.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:07.501+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:08.119 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:08.105+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:08.491 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:08.477+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:09.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:09.069+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:09.471 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:09.457+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:10.107 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:10.093+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:10.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:10.425+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:11.101 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:11.089+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:11.439 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:11.429+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:12.138 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:12.125+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:12.487 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:12.473+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:13.155 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:13.145+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:13.492 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:13.481+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:14.177 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:14.165+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:14.506 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:14.493+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:15.183 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:15.173+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:15.493 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:15.485+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:16.202 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:16.193+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:16.544 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:16.537+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:17.217 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:17.209+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:17.537 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:17.525+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:18.261 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:18.253+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:18.569 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:18.561+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:19.217 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:19.205+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:19.618 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:19.609+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:20.182 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:20.173+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:20.646 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:20.637+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:21.193 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:21.185+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:21.676 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:21.665+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:22.163 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:22.153+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:22.668 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:22.661+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:23.185 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:23.177+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:23.702 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:23.693+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:24.189 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:24.173+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:24.748 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:24.737+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:25.138 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:25.129+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:25.722 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:25.713+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:26.161 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:26.153+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:26.720 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:26.713+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:27.171 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:27.161+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:27.713 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:27.701+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:28.198 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:28.185+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:28.679 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:28.669+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:29.237 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:29.225+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:29.653 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:29.645+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:30.243 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:30.233+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:30.632 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:30.625+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:31.264 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:31.253+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:31.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:31.601+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:32.247 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:32.237+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:32.587 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:32.577+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:33.213 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:33.201+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:33.587 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:33.577+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:34.257 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:34.249+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:34.582 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:34.573+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:35.282 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:35.273+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:35.610 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:35.601+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:36.317 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:36.309+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:36.632 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:36.621+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:37.273 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:37.265+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:37.610 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:37.601+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:38.308 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:38.297+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:38.658 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:38.649+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:39.277 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:39.269+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:39.709 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:39.693+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:40.275 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:40.265+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:40.676 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:40.665+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:41.293 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:41.285+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:41.710 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:41.701+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:42.290 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:42.281+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:42.706 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:42.697+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:43.246 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:43.237+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:43.733 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:43.725+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:44.276 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:44.265+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:44.712 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:44.705+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:45.254 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:45.245+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:45.767 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:45.749+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:46.258 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:46.249+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:46.752 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:46.741+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:47.282 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:47.273+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:47.705 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:47.697+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:48.268 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:48.257+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:48.678 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:48.669+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:49.254 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:49.245+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:49.638 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:49.625+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:50.304 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:50.293+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:50.607 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:50.597+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:51.338 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:51.329+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:51.595 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:51.585+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:52.351 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:52.337+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:52.578 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:52.569+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:53.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:53.293+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:53.613 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:53.601+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:54.286 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:54.273+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:54.627 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:54.617+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:55.318 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:55.309+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:55.633 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:55.625+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:56.321 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:56.305+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:56.656 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:56.649+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:57.324 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:57.313+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:57.621 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:57.613+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:58.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:58.277+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:58.642 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:58.633+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:09:59.255 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:09:59.245+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:09:59.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:09:59.605+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:00.269 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:00.261+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:00.570 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:00.561+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:01.299 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:01.289+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:01.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:01.529+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:02.320 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:02.313+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:02.533 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:02.525+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:03.296 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:03.289+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:03.534 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:03.525+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:04.285 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:04.277+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:04.546 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:04.537+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:05.250 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:05.241+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:05.570 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:05.561+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:06.259 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:06.249+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:06.543 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:06.533+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:07.214 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:07.205+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:07.546 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:07.537+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:08.254 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:08.245+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:08.540 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:08.529+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:09.231 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:09.221+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:09.555 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:09.545+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:10.197 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:10.189+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:10.563 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:10.553+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:11.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:11.233+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:11.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:11.565+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:12.204 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:12.193+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:12.628 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:12.617+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:13.244 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:13.237+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:13.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:13.593+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:14.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:14.213+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:14.602 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:14.593+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:15.247 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:15.237+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:15.600 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:15.589+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:16.224 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:16.213+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:16.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:16.617+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:17.256 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:17.245+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:17.663 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:17.653+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:18.263 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:18.253+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:18.634 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:18.625+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:19.271 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:19.261+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:19.635 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:19.625+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:20.238 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:20.229+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:20.617 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:20.609+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:21.287 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:21.276+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:21.569 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:21.560+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:22.263 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:22.252+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:22.543 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:22.532+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:23.239 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:23.228+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:23.504 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:23.492+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:24.276 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:24.264+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:24.468 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:24.456+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:25.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:25.300+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:25.517 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:25.508+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:26.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:26.336+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:26.531 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:26.520+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:27.376 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:27.364+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:27.540 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:27.528+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:28.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:28.392+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:28.499 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:28.488+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:29.368 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:29.356+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:29.520 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:29.508+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:30.343 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:30.332+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:30.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:30.516+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:31.307 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:31.296+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:31.511 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:31.500+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:32.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:32.344+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:32.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:32.508+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:33.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:33.380+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:33.500 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:33.488+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:34.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:34.408+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:34.469 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:34.460+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:35.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:35.428+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:35.439 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:35.428+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:36.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:36.380+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:36.420 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:36.408+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:37.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:37.400+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:37.430 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:37.420+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:38.407 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:38.396+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:38.432 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:38.420+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:39.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:39.360+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:39.409 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:39.400+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:40.371 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:40.360+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:40.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:40.376+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:41.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:41.332+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:41.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:41.364+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:42.329 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:42.320+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:42.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:42.364+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:43.332 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:43.320+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:43.348 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:43.340+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:44.287 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:44.276+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:44.389 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:44.380+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:45.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:45.300+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:45.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:45.368+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:46.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:46.336+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:46.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:46.368+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:47.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:47.360+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:47.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:47.364+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:48.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:48.360+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:48.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:48.392+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:49.346 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:49.336+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:49.355 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:49.344+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:50.315 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:50.304+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:50.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:50.344+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:51.325 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:51.316+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:51.338 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:51.328+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:52.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:52.288+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:52.345 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:52.336+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:53.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:53.288+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:53.391 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:53.380+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:54.334 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:54.324+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:54.416 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:54.404+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:55.291 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:55.280+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:55.463 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:55.452+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:56.252 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:56.240+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:56.484 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:56.472+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:57.281 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:57.272+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:57.531 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:57.520+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:58.262 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:58.252+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:58.575 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:58.564+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:10:59.303 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:10:59.292+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:10:59.535 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:10:59.524+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:00.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:00.276+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:00.512 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:00.500+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:01.277 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:01.268+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:01.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:01.504+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:02.310 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:02.300+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:02.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:02.468+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:03.329 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:03.320+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:03.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:03.504+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:04.347 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:04.336+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:04.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:04.528+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:05.398 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:05.388+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:05.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:05.564+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:06.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:06.376+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:06.561 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:06.552+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:07.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:07.392+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:07.571 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:07.560+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:08.438 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:08.428+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:08.535 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:08.524+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:09.394 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:09.384+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:09.492 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:09.480+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:10.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:10.396+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:10.503 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:10.492+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:11.407 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:11.396+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:11.536 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:11.524+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:12.419 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:12.408+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:12.508 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:12.496+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:13.462 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:13.452+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:13.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:13.452+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:14.450 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:14.440+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:14.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:14.452+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:15.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:15.428+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:15.500 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:15.488+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:16.425 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:16.412+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:16.549 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:16.540+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:17.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:17.372+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:17.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:17.552+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:18.407 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:18.396+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:18.598 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:18.588+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:19.455 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:19.444+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:19.575 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:19.564+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:20.425 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:20.416+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:20.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:20.564+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:21.417 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:21.408+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:21.543 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:21.532+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:22.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:22.400+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:22.509 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:22.500+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:23.462 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:23.452+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:23.532 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:23.520+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:24.472 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:24.460+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:24.512 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:24.500+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:25.445 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:25.436+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:25.530 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:25.520+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:26.413 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:26.404+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:26.512 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:26.496+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:27.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:27.427+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:27.503 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:27.491+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:28.473 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:28.459+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:28.530 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:28.519+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:29.426 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:29.415+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:29.523 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:29.511+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:30.383 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:30.371+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:30.524 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:30.511+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:31.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:31.327+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:31.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:31.551+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:32.368 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:32.355+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:32.546 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:32.535+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:33.361 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:33.347+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:33.584 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:33.571+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:34.353 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:34.339+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:34.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:34.591+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:35.338 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:35.327+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:35.644 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:35.631+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:36.307 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:36.295+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:36.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:36.615+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:37.303 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:37.291+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:37.611 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:37.599+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:38.290 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:38.279+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:38.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:38.591+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:39.244 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:39.231+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:39.646 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:39.635+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:40.268 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:40.255+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:40.696 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:40.683+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:41.240 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:41.227+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:41.736 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:41.723+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:42.259 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:42.247+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:42.759 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:42.747+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:43.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:43.223+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:43.801 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:43.791+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:44.278 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:44.267+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:44.765 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:44.755+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:45.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:45.275+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:45.730 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:45.719+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:46.282 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:46.271+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:46.767 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:46.755+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:47.307 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:47.295+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:47.812 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:47.799+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:48.274 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:48.263+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:48.828 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:48.815+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:49.302 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:49.291+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:49.795 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:49.783+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:50.319 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:50.303+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:50.756 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:50.743+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:51.336 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:51.323+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:51.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:51.783+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:52.352 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:52.339+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:52.781 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:52.767+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:53.403 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:53.391+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:53.792 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:53.779+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:54.416 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:54.403+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:54.775 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:54.763+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:55.428 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:55.415+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:55.744 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:55.731+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:56.477 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:56.467+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:56.727 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:56.715+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:57.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:57.423+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:57.717 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:57.703+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:58.400 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:58.387+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:58.760 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:58.747+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:11:59.365 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:11:59.355+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:11:59.791 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:11:59.779+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:00.385 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:00.375+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:00.763 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:00.751+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:01.343 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:01.331+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:01.753 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:01.743+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:02.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:02.359+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:02.723 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:02.711+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:03.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:03.407+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:03.678 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:03.667+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:04.437 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:04.427+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:04.632 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:04.619+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:05.395 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:05.383+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:05.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:05.591+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:06.399 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:06.387+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:06.648 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:06.635+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:07.449 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:07.439+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:07.675 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:07.663+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:08.476 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:08.463+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:08.699 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:08.687+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:09.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:09.423+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:09.732 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:09.719+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:10.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:10.423+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:10.702 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:10.691+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:11.480 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:11.467+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:11.655 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:11.643+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:12.524 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:12.511+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:12.659 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:12.647+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:13.519 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:13.507+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:13.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:13.675+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:14.491 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:14.479+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:14.722 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:14.711+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:15.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:15.455+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:15.734 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:15.723+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:16.482 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:16.471+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:16.688 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:16.675+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:17.451 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:17.439+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:17.732 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:17.723+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:18.452 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:18.439+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:18.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:18.735+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:19.423 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:19.411+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:19.761 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:19.751+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:20.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:20.431+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:20.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:20.799+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:21.486 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:21.475+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:21.763 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:21.751+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:22.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:22.495+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:22.766 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:22.755+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:23.546 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:23.535+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:23.750 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:23.739+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:24.582 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:24.571+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:24.790 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:24.779+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:25.600 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:25.591+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:25.817 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:25.807+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:26.644 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:26.631+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:26.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:26.763+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:27.689 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:27.679+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:27.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:27.811+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:28.678 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:28.667+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:28.788 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:28.775+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:29.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:29.643+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:29.747 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:29.735+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:30.653 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:30.643+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:30.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:30.783+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:31.664 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:31.651+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:31.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:31.795+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:32.631 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:32.619+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:32.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:32.831+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:33.643 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:33.631+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:33.864 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:33.855+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:34.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:34.667+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:34.879 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:34.867+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:35.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:35.691+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:35.878 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:35.867+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:36.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:36.695+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:36.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:36.843+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:37.706 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:37.695+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:37.859 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:37.847+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:38.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:38.731+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:38.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:38.891+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:39.722 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:39.711+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:39.862 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:39.851+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:40.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:40.751+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:40.848 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:40.835+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:41.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:41.735+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:41.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:41.823+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:42.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:42.731+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:42.801 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:42.791+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:43.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:43.751+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:43.773 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:43.763+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:44.767 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:44.755+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:44.783 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:44.771+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:45.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:45.739+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:45.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:45.787+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:46.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:46.695+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:46.829 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:46.819+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:47.693 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:47.683+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:47.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:47.843+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:48.732 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:48.719+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:48.874 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:48.863+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:49.691 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:49.679+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:49.886 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:49.875+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:50.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:50.703+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:50.906 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:50.895+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:51.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:51.715+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:51.927 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:51.915+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:52.689 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:52.679+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:52.905 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:52.895+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:53.654 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:53.643+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:53.881 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:53.871+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:54.698 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:54.687+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:54.921 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:54.911+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:55.712 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:55.699+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:55.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:55.907+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:56.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:56.691+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:56.922 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:56.911+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:57.672 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:57.663+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:57.902 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:57.891+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:58.654 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:58.643+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:58.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:58.907+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:12:59.627 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:12:59.615+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:12:59.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:12:59.891+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:00.644 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:00.631+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:00.951 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:00.939+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:01.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:01.671+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:01.913 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:01.903+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:02.645 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:02.635+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:02.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:02.871+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:03.599 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:03.587+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:03.901 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:03.891+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:04.562 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:04.551+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:04.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:04.915+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:05.550 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:05.539+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:05.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:05.947+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:06.550 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:06.539+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:06.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:06.927+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:07.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:07.547+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:07.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:07.931+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:08.565 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:08.555+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:08.992 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:08.983+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:09.617 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:09.607+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:09.996 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:09.983+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:10.572 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:10.563+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:10.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:10.967+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:11.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:11.543+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:11.977 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:11.967+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:12.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:12.531+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:12.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:12.955+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:13.503 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:13.491+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:13.996 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:13.987+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:14.510 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:14.499+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:15.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:15.031+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:15.547 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:15.535+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:16.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:16.031+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:16.595 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:16.583+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:17.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:16.991+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:17.606 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:17.595+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:18.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:18.031+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:18.624 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:18.615+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:19.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:18.995+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:19.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:19.567+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:19.974 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:19.963+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:20.603 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:20.591+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:20.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:20.923+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:21.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:21.551+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:21.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:21.947+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:22.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:22.527+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:22.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:22.919+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:23.513 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:23.503+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:23.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:23.919+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:24.531 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:24.519+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:24.936 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:24.923+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:25.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:25.527+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:25.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:25.903+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:26.541 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:26.531+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:26.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:26.923+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:27.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:27.527+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:27.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:27.959+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:28.564 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:28.551+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:28.971 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:28.959+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:29.610 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:29.599+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:29.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:29.943+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:30.648 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:30.639+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:30.987 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:30.975+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:31.627 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:31.615+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:32.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:31.991+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:32.671 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:32.659+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:32.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:32.943+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:33.684 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:33.671+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:33.911 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:33.899+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:34.657 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:34.647+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:34.874 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:34.863+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:35.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:35.691+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:35.833 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:35.823+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:36.722 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:36.711+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:36.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:36.827+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:37.746 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:37.735+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:37.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:37.807+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:38.725 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:38.715+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:38.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:38.843+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:39.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:39.747+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:39.857 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:39.847+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:40.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:40.747+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:40.837 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:40.827+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:41.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:41.791+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:41.837 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:41.827+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:42.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:42.783+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:42.806 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:42.795+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:43.777 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:43.767+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:43.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:43.795+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:44.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:44.767+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:44.828 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:44.819+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:45.777 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:45.767+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:45.858 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:45.847+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:46.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:46.795+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:46.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:46.827+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:47.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:47.799+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:47.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:47.799+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:48.798 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:48.787+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:48.827 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:48.815+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:49.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:49.807+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:49.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:49.815+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:50.794 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:50.783+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:50.812 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:50.803+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:51.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:51.763+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:51.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:51.771+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:52.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:52.727+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:52.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:52.799+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:53.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:53.723+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:53.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:53.783+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:54.721 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:54.711+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:54.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:54.791+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:55.713 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:55.703+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:55.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:55.795+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:56.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:56.739+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:56.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:56.767+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:57.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:57.735+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:57.789 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:57.779+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:58.714 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:58.703+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:58.786 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:58.775+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:13:59.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:13:59.655+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:13:59.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:13:59.815+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:00.682 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:00.671+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:00.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:00.775+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:01.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:01.667+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:01.761 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:01.751+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:02.662 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:02.651+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:02.787 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:02.775+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:03.627 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:03.615+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:03.798 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:03.787+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:04.624 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:04.615+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:04.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:04.811+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:05.621 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:05.611+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:05.823 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:05.811+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:06.639 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:06.627+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:06.783 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:06.771+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:07.618 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:07.607+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:07.775 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:07.763+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:08.621 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:08.611+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:08.738 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:08.727+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:09.635 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:09.623+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:09.764 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:09.751+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:10.680 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:10.671+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:10.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:10.791+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:11.685 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:11.675+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:11.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:11.839+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:12.709 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:12.699+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:12.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:12.871+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:13.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:13.691+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:13.863 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:13.851+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:14.729 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:14.719+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:14.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:14.839+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:15.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:15.699+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:15.884 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:15.871+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:16.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:16.699+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:16.879 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:16.867+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:17.687 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:17.675+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:17.906 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:17.895+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:18.665 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:18.655+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:18.906 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:18.895+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:19.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:19.667+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:19.933 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:19.923+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:20.636 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:20.627+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:20.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:20.883+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:21.651 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:21.639+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:21.898 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:21.887+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:22.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:22.667+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:22.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:22.919+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:23.646 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:23.635+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:23.912 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:23.903+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:24.676 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:24.663+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:24.901 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:24.891+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:25.672 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:25.659+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:25.885 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:25.875+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:26.682 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:26.671+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:26.933 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:26.923+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:27.733 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:27.723+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:27.922 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:27.911+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:28.777 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:28.767+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:28.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:28.943+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:29.787 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:29.775+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:29.983 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:29.971+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:30.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:30.735+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:30.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:30.967+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:31.770 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:31.759+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:31.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:31.947+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:32.746 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:32.735+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:32.989 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:32.979+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:33.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:33.723+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:33.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:33.939+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:34.773 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:34.763+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:34.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:34.903+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:35.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:35.799+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:35.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:35.915+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:36.764 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:36.751+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:36.881 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:36.871+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:37.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:37.771+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:37.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:37.907+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:38.742 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:38.731+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:38.912 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:38.899+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:39.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:39.707+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:39.889 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:39.879+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:40.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:40.707+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:40.877 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:40.867+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:41.706 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:41.695+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:41.879 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:41.867+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:42.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:42.695+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:42.901 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:42.891+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:43.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:43.747+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:43.882 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:43.871+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:44.799 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:44.787+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:44.921 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:44.911+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:45.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:45.795+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:45.924 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:45.915+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:46.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:46.795+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:46.924 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:46.915+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:47.780 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:47.767+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:47.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:47.871+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:48.744 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:48.735+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:48.923 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:48.911+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:49.761 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:49.751+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:49.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:49.955+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:50.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:50.743+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:50.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:50.963+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:51.789 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:51.779+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:51.993 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:51.983+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:52.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:52.811+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:52.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:52.955+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:53.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:53.819+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:53.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:53.963+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:54.881 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:54.871+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:54.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:54.919+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:55.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:55.835+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:55.913 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:55.903+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:56.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:56.859+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:56.904 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:56.891+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:57.862 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:57.851+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:57.886 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:57.875+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:58.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:58.811+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:58.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:58.907+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:14:59.813 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:14:59.803+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:14:59.960 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:14:59.947+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:00.783 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:00.771+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:00.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:00.967+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:01.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:01.807+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:02.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:01.991+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:02.859 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:02.847+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:03.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:03.007+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:03.909 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:03.899+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:04.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:04.035+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:04.942 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:04.931+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:05.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:05.031+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:05.981 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:05.971+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:06.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:06.063+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:06.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:06.947+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:07.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:07.107+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:07.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:07.923+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:08.078 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:08.067+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:08.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:08.903+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:09.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:09.091+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:09.948 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:09.939+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:10.099 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:10.087+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:10.949 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:10.939+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:11.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:11.119+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:11.958 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:11.947+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:12.124 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:12.111+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:12.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:12.903+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:13.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:13.131+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:13.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:13.955+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:14.134 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:14.123+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:14.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:14.907+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:15.101 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:15.091+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:15.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:15.955+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:16.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:16.131+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:17.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:16.991+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:17.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:17.131+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:18.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:18.007+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:18.102 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:18.091+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:19.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:19.019+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:19.150 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:19.139+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:19.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:19.987+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:20.190 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:20.179+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:20.983 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:20.971+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:21.163 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:21.151+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:22.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:21.991+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:22.199 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:22.187+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:23.036 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:23.026+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:23.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:23.162+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:24.065 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:24.054+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:24.153 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:24.142+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:25.031 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:25.018+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:25.201 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:25.190+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:26.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:26.050+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:26.193 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:26.182+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:27.088 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:27.078+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:27.157 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:27.146+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:28.045 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:28.034+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:28.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:28.166+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:29.046 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:29.034+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:29.166 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:29.154+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:30.052 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:30.042+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:30.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:30.158+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:31.038 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:31.026+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:31.125 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:31.114+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:31.994 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:31.982+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:32.133 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:32.122+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:32.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:32.978+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:33.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:33.154+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:33.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:33.934+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:34.159 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:34.146+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:34.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:34.946+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:35.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:35.162+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:35.956 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:35.942+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:36.213 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:36.202+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:36.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:36.922+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:37.166 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:37.154+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:37.920 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:37.910+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:38.159 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:38.146+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:38.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:38.950+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:39.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:39.146+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:40.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:39.990+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:40.166 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:40.154+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:41.045 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:41.034+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:41.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:41.126+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:42.095 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:42.082+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:42.096 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:42.082+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:43.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:43.058+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:43.123 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:43.110+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:44.080 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:44.070+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:44.155 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:44.142+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:45.119 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:45.106+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:45.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:45.178+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:46.113 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:46.102+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:46.198 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:46.186+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:47.076 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:47.066+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:47.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:47.142+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:48.090 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:48.078+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:48.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:48.182+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:49.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:49.078+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:49.188 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:49.178+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:50.118 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:50.106+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:50.186 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:50.174+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:51.100 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:51.090+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:51.218 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:51.206+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:52.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:52.106+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:52.269 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:52.258+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:53.111 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:53.098+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:53.302 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:53.290+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:54.100 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:54.086+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:54.351 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:54.338+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:55.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:55.058+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:55.389 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:55.378+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:56.084 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:56.074+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:56.353 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:56.342+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:57.060 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:57.050+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:57.400 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:57.386+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:58.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:58.090+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:58.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:58.346+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:15:59.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:15:59.082+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:15:59.385 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:15:59.374+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:00.073 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:00.062+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:00.419 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:00.406+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:01.056 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:01.046+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:01.451 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:01.438+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:02.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:02.058+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:02.471 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:02.458+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:03.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:03.082+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:03.450 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:03.438+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:04.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:04.058+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:04.429 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:04.418+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:05.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:05.042+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:05.462 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:05.450+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:06.069 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:06.058+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:06.498 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:06.486+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:07.107 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:07.094+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:07.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:07.530+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:08.068 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:08.058+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:08.520 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:08.510+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:09.021 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:09.010+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:09.561 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:09.550+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:10.025 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:10.014+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:10.529 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:10.518+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:10.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:10.986+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:11.527 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:11.514+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:12.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:12.030+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:12.514 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:12.502+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:13.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:12.990+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:13.467 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:13.454+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:14.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:14.006+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:14.446 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:14.434+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:15.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:14.994+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:15.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:15.458+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:15.961 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:15.950+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:16.518 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:16.506+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:16.977 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:16.966+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:17.558 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:17.546+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:18.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:17.994+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:18.586 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:18.574+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:19.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:18.998+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:19.583 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:19.570+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:20.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:20.022+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:20.598 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:20.586+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:21.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:21.018+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:21.594 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:21.582+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:22.031 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:22.018+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:22.549 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:22.538+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:23.027 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:23.014+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:23.524 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:23.510+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:24.059 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:24.046+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:24.497 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:24.486+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:25.109 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:25.098+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:25.499 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:25.486+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:26.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:26.078+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:26.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:26.446+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:27.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:27.058+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:27.414 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:27.402+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:28.111 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:28.098+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:28.374 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:28.362+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:29.151 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:29.138+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:29.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:29.366+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:30.152 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:30.142+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:30.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:30.354+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:31.111 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:31.098+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:31.347 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:31.334+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:32.107 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:32.094+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:32.398 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:32.386+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:33.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:33.078+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:33.431 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:33.418+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:34.053 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:34.042+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:34.469 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:34.458+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:35.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:35.030+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:35.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:35.426+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:36.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:36.018+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:36.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:36.450+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:37.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:37.006+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:37.428 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:37.418+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:38.048 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:38.038+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:38.426 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:38.414+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:39.025 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:39.014+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:39.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:39.378+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:40.032 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:40.018+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:40.429 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:40.418+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:41.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:40.994+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:41.433 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:41.422+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:41.988 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:41.978+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:42.425 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:42.414+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:42.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:42.962+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:43.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:43.390+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:43.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:43.922+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:44.442 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:44.430+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:44.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:44.954+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:45.462 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:45.450+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:45.988 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:45.974+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:46.475 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:46.462+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:46.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:46.954+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:47.427 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:47.414+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:47.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:47.918+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:48.437 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:48.426+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:48.954 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:48.942+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:49.488 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:49.474+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:49.989 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:49.978+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:50.514 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:50.502+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:50.974 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:50.962+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:51.479 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:51.466+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:51.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:51.962+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:52.508 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:52.494+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:52.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:52.942+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:53.499 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:53.485+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:53.960 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:53.949+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:54.532 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:54.517+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:54.995 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:54.981+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:55.551 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:55.537+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:56.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:56.029+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:56.585 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:56.573+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:57.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:57.041+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:57.577 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:57.565+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:58.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:58.013+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:58.598 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:58.585+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:16:59.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:16:59.041+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:16:59.553 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:16:59.541+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:00.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:00.045+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:00.601 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:00.589+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:01.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:00.997+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:01.626 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:01.617+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:02.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:02.033+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:02.597 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:02.585+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:03.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:02.993+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:03.575 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:03.565+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:03.993 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:03.985+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:04.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:04.545+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:05.004 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:04.993+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:05.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:05.529+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:06.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:06.025+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:06.587 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:06.577+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:07.061 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:07.053+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:07.626 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:07.617+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:08.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:08.077+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:08.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:08.625+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:09.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:09.057+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:09.646 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:09.637+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:10.052 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:10.041+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:10.627 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:10.617+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:11.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:10.997+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:11.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:11.661+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:12.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:12.045+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:12.653 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:12.645+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:13.032 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:13.021+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:13.689 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:13.681+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:14.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:14.005+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:14.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:14.657+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:15.064 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:15.053+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:15.680 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:15.673+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:16.069 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:16.061+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:16.641 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:16.633+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:17.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:17.053+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:17.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:17.661+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:18.076 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:18.069+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:18.713 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:18.705+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:19.078 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:19.069+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:19.752 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:19.745+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:20.048 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:20.041+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:20.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:20.733+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:21.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:21.081+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:21.758 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:21.749+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:22.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:22.057+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:22.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:22.717+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:23.117 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:23.109+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:23.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:23.741+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:24.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:24.089+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:24.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:24.697+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:25.133 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:25.125+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:25.740 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:25.729+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:26.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:26.117+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:26.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:26.697+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:27.115 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:27.101+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:27.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:27.709+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:28.078 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:28.069+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:28.681 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:28.669+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:29.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:29.109+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:29.708 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:29.693+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:30.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:30.081+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:30.752 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:30.741+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:31.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:31.109+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:31.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:31.705+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:32.152 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:32.141+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:32.733 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:32.721+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:33.129 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:33.117+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:33.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:33.745+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:34.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:34.081+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:34.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:34.769+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:35.066 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:35.053+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:35.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:35.813+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:36.039 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:36.025+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:36.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:36.813+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:37.063 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:37.049+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:37.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:37.805+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:38.069 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:38.057+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:38.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:38.849+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:39.046 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:39.033+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:39.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:39.833+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:40.005 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:39.993+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:40.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:40.845+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:41.004 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:40.993+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:41.887 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:41.874+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:42.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:42.018+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:42.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:42.842+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:43.051 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:43.038+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:43.820 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:43.806+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:44.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:44.002+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:44.865 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:44.854+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:45.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:45.022+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:45.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:45.858+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:45.998 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:45.986+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:46.909 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:46.898+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:47.015 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:47.002+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:47.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:47.942+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:47.991 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:47.982+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:48.958 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:48.946+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:49.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:49.030+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:49.927 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:49.914+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:50.060 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:50.050+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:50.891 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:50.878+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:51.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:51.070+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:51.881 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:51.870+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:52.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:52.034+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:52.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:52.842+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:53.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:53.030+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:53.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:53.806+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:53.994 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:53.982+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:54.788 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:54.778+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:54.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:54.938+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:55.765 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:55.754+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:55.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:55.970+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:56.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:56.738+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:57.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:57.002+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:57.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:57.770+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:58.060 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:58.050+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:58.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:58.762+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:17:59.019 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:17:59.010+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:17:59.748 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:17:59.738+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:00.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:00.050+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:00.749 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:00.738+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:01.099 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:01.086+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:01.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:01.694+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:02.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:02.042+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:02.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:02.698+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:03.029 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:03.018+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:03.682 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:03.670+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:04.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:04.046+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:04.694 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:04.682+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:05.073 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:05.062+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:05.648 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:05.638+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:06.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:06.082+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:06.694 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:06.682+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:07.136 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:07.126+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:07.722 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:07.710+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:08.149 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:08.138+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:08.696 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:08.686+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:09.123 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:09.110+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:09.724 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:09.714+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:10.145 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:10.134+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:10.772 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:10.762+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:11.174 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:11.162+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:11.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:11.718+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:12.199 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:12.190+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:12.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:12.690+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:13.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:13.174+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:13.689 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:13.678+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:14.201 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:14.190+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:14.682 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:14.670+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:15.173 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:15.162+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:15.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:15.666+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:16.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:16.122+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:16.652 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:16.642+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:17.165 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:17.154+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:17.643 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:17.634+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:18.123 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:18.114+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:18.643 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:18.630+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:19.166 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:19.154+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:19.612 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:19.602+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:20.205 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:20.194+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:20.610 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:20.598+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:21.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:21.158+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:21.615 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:21.606+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:22.129 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:22.118+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:22.567 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:22.554+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:23.096 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:23.086+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:23.611 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:23.602+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:24.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:24.134+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:24.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:24.622+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:25.148 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:25.138+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:25.609 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:25.598+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:26.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:26.182+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:26.626 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:26.614+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:27.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:27.230+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:27.638 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:27.626+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:28.196 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:28.186+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:28.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:28.666+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:29.201 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:29.190+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:29.687 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:29.674+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:30.235 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:30.222+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:30.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:30.654+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:31.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:31.250+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:31.695 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:31.686+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:32.227 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:32.218+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:32.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:32.662+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:33.187 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:33.178+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:33.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:33.698+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:34.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:34.174+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:34.724 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:34.714+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:35.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:35.170+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:35.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:35.722+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:36.227 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:36.218+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:36.708 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:36.698+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:37.261 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:37.250+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:37.699 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:37.690+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:38.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:38.242+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:38.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:38.686+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:39.269 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:39.258+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:39.740 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:39.730+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:40.314 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:40.302+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:40.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:40.694+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:41.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:41.266+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:41.686 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:41.674+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:42.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:42.298+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:42.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:42.690+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:43.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:43.266+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:43.729 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:43.718+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:44.271 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:44.258+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:44.748 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:44.738+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:45.310 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:45.298+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:45.753 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:45.742+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:46.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:46.306+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:46.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:46.706+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:47.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:47.350+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:47.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:47.754+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:48.338 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:48.326+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:48.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:48.742+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:49.302 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:49.290+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:49.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:49.782+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:50.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:50.246+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:50.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:50.762+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:51.266 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:51.254+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:51.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:51.798+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:52.249 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:52.238+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:52.859 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:52.850+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:53.218 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:53.206+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:53.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:53.862+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:54.244 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:54.234+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:54.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:54.834+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:55.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:55.246+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:55.838 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:55.826+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:56.214 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:56.202+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:56.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:56.782+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:57.213 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:57.202+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:57.821 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:57.810+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:58.196 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:58.186+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:58.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:58.778+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:18:59.227 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:18:59.218+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:18:59.788 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:18:59.778+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:00.249 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:00.238+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:00.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:00.782+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:01.279 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:01.270+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:01.821 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:01.810+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:02.261 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:02.250+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:02.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:02.814+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:03.248 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:03.238+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:03.874 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:03.862+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:04.252 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:04.242+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:04.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:04.906+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:05.248 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:05.238+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:05.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:05.950+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:06.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:06.222+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:06.976 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:06.966+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:07.246 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:07.234+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:08.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:08.002+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:08.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:08.250+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:08.998 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:08.986+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:09.266 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:09.254+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:09.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:09.962+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:10.250 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:10.238+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:10.926 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:10.914+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:11.224 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:11.214+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:11.937 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:11.926+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:12.202 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:12.190+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:12.925 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:12.914+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:13.197 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:13.186+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:13.948 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:13.938+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:14.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:14.210+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:14.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:14.950+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:15.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:15.234+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:15.931 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:15.922+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:16.268 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:16.258+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:16.889 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:16.878+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:17.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:17.286+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:17.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:17.882+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:18.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:18.286+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:18.913 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:18.902+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:19.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:19.250+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:19.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:19.882+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:20.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:20.254+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:20.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:20.846+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:21.311 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:21.302+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:21.846 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:21.834+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:22.269 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:22.258+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:22.842 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:22.830+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:23.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:23.222+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:23.857 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:23.846+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:24.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:24.266+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:24.866 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:24.854+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:25.286 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:25.278+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:25.843 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:25.834+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:26.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:26.318+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:26.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:26.806+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:27.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:27.350+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:27.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:27.834+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:28.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:28.338+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:28.864 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:28.854+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:29.355 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:29.346+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:29.874 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:29.862+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:30.378 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:30.366+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:30.880 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:30.870+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:31.426 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:31.414+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:31.903 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:31.894+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:32.378 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:32.366+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:32.921 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:32.910+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:33.379 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:33.370+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:33.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:33.890+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:34.349 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:34.338+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:34.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:34.938+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:35.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:35.362+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:35.944 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:35.934+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:36.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:36.350+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:36.914 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:36.902+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:37.330 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:37.318+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:37.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:37.906+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:38.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:38.362+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:38.897 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:38.886+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:39.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:39.366+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:39.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:39.898+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:40.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:40.374+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:40.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:40.878+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:41.340 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:41.330+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:41.863 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:41.854+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:42.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:42.322+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:42.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:42.846+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:43.288 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:43.278+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:43.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:43.874+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:44.317 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:44.306+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:44.877 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:44.866+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:45.321 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:45.310+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:45.905 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:45.894+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:46.321 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:46.310+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:46.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:46.918+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:47.286 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:47.278+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:47.975 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:47.966+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:48.260 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:48.246+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:48.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:48.950+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:49.299 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:49.290+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:49.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:49.966+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:50.340 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:50.330+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:50.961 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:50.950+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:51.355 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:51.346+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:52.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:51.994+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:52.321 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:52.310+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:53.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:53.002+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:53.338 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:53.326+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:54.019 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:54.010+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:54.339 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:54.330+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:55.034 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:55.022+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:55.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:55.294+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:56.077 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:56.066+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:56.341 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:56.330+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:57.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:57.078+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:57.299 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:57.290+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:58.135 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:58.126+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:58.301 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:58.290+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:19:59.145 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:19:59.134+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:19:59.271 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:19:59.262+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:00.103 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:00.094+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:00.245 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:00.234+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:01.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:01.098+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:01.271 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:01.258+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:02.121 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:02.110+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:02.260 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:02.250+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:03.081 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:03.070+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:03.248 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:03.238+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:04.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:04.102+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:04.292 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:04.282+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:05.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:05.106+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:05.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:05.326+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:06.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:06.062+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:06.381 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:06.370+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:07.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:07.106+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:07.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:07.390+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:08.092 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:08.082+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:08.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:08.366+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:09.052 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:09.042+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:09.361 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:09.350+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:10.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:10.034+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:10.349 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:10.338+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:11.019 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:11.010+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:11.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:11.310+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:12.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:11.994+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:12.321 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:12.310+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:12.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:12.986+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:13.366 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:13.354+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:14.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:14.006+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:14.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:14.322+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:14.983 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:14.974+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:15.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:15.274+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:15.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:15.986+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:16.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:16.242+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:16.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:16.978+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:17.251 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:17.242+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:17.940 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:17.930+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:18.269 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:18.258+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:18.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:18.962+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:19.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:19.250+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:19.998 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:19.990+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:20.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:20.230+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:21.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:21.026+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:21.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:21.266+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:22.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:22.030+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:22.258 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:22.246+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:23.011 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:23.002+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:23.228 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:23.218+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:24.038 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:24.026+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:24.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:24.174+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:25.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:25.050+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:25.190 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:25.182+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:26.080 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:26.070+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:26.232 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:26.222+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:27.042 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:27.034+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:27.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:27.226+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:28.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:27.994+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:28.287 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:28.278+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:28.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:28.970+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:29.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:29.302+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:29.940 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:29.930+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:30.354 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:30.342+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:30.948 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:30.938+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:31.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:31.310+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:31.902 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:31.894+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:32.293 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:32.282+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:32.901 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:32.890+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:33.266 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:33.258+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:33.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:33.862+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:34.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:34.250+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:34.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:34.830+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:35.227 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:35.218+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:35.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:35.850+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:36.256 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:36.246+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:36.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:36.826+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:37.234 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:37.226+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:37.854 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:37.846+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:38.204 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:38.194+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:38.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:38.830+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:39.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:39.186+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:39.865 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:39.854+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:40.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:40.170+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:40.909 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:40.898+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:41.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:41.178+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:41.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:41.910+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:42.151 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:42.142+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:42.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:42.958+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:43.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:43.186+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:43.951 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:43.942+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:44.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:44.158+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:44.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:44.898+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:45.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:45.154+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:45.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:45.874+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:46.152 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:46.142+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:46.862 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:46.854+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:47.171 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:47.162+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:47.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:47.898+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:48.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:48.126+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:48.867 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:48.858+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:49.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:49.082+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:49.882 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:49.874+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:50.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:50.074+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:50.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:50.898+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:51.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:51.070+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:51.911 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:51.902+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:52.080 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:52.070+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:52.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:52.906+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:53.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:53.062+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:53.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:53.954+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:54.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:54.034+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:55.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:54.994+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:55.078 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:55.066+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:56.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:55.994+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:56.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:56.022+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:57.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:57.006+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:57.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:57.034+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:58.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:57.994+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:58.008 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:57.998+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:20:59.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:20:59.026+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:20:59.059 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:20:59.050+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:00.027 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:00.018+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:00.037 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:00.026+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:01.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:01.010+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:01.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:01.018+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:01.984 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:01.974+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:01.994 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:01.986+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:03.005 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:02.994+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:03.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:03.006+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:04.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:03.990+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:04.019 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:04.010+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:05.008 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:04.998+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:05.063 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:05.054+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:05.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:05.950+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:06.044 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:06.034+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:06.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:06.918+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:07.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:07.054+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:07.920 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:07.910+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:08.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:08.006+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:08.891 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:08.882+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:09.012 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:09.002+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:09.882 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:09.873+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:09.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:09.961+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:10.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:10.885+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:10.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:10.953+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:11.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:11.885+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:11.986 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:11.977+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:12.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:12.881+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:13.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:13.009+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:13.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:13.909+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:14.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:14.021+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:14.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:14.905+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:14.989 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:14.977+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:15.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:15.905+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:16.005 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:15.993+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:16.880 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:16.869+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:16.967 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:16.957+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:17.863 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:17.853+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:17.942 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:17.929+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:18.886 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:18.877+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:18.907 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:18.897+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:19.865 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:19.853+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:19.936 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:19.925+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:20.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:20.829+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:20.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:20.965+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:21.867 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:21.857+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:21.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:21.921+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:22.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:22.865+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:22.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:22.921+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:23.884 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:23.873+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:23.909 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:23.901+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:24.904 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:24.893+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:24.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:24.945+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:25.886 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:25.877+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:25.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:25.953+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:26.887 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:26.881+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:27.007 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:26.997+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:27.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:27.845+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:27.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:27.973+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:28.872 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:28.865+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:29.026 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:29.021+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:29.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:29.909+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:30.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:30.069+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:30.937 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:30.929+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:31.045 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:31.037+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:31.928 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:31.921+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:32.052 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:32.045+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:32.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:32.957+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:33.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:33.057+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:33.974 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:33.969+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:34.058 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:34.053+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:35.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:34.993+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:35.080 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:35.073+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:36.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:36.009+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:36.049 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:36.041+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:37.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:37.017+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:37.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:37.077+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:37.985 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:37.977+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:38.038 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:38.033+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:38.939 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:38.933+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:39.068 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:39.061+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:39.920 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:39.913+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:40.040 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:40.033+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:40.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:40.933+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:40.993 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:40.985+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:41.949 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:41.941+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:41.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:41.949+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:42.904 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:42.897+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:42.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:42.925+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:43.899 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:43.893+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:43.961 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:43.953+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:44.853 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:44.845+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:44.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:44.965+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:45.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:45.849+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:46.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:46.009+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:46.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:46.889+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:47.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:47.037+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:47.887 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:47.881+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:48.066 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:48.057+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:48.921 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:48.913+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:49.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:49.061+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:49.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:49.889+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:50.111 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:50.105+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:50.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:50.885+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:51.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:51.073+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:51.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:51.841+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:52.118 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:52.113+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:52.869 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:52.861+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:53.102 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:53.097+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:53.840 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:53.833+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:54.131 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:54.125+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:54.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:54.841+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:55.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:55.125+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:55.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:55.809+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:56.169 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:56.161+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:56.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:56.825+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:57.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:57.137+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:57.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:57.817+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:58.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:58.165+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:58.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:58.789+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:21:59.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:21:59.161+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:21:59.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:21:59.817+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:00.127 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:00.121+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:00.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:00.825+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:01.101 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:01.093+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:01.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:01.865+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:02.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:02.097+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:02.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:02.845+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:03.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:03.113+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:03.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:03.809+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:04.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:04.081+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:04.863 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:04.857+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:05.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:05.049+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:05.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:05.853+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:06.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:06.013+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:06.904 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:06.897+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:07.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:07.037+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:07.941 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:07.933+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:08.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:08.041+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:08.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:08.957+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:09.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:09.065+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:09.993 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:09.985+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:10.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:10.085+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:11.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:11.033+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:11.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:11.081+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:12.069 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:12.061+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:12.070 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:12.065+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:13.025 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:13.017+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:13.031 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:13.025+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:13.985 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:13.977+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:14.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:14.001+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:15.005 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:14.997+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:15.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:14.997+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:15.980 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:15.973+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:16.040 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:16.033+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:16.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:16.989+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:17.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:17.009+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:17.984 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:17.977+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:18.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:17.993+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:18.944 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:18.937+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:18.980 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:18.973+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:19.942 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:19.937+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:19.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:19.965+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:20.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:20.921+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:20.938 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:20.933+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:21.971 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:21.965+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:21.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:21.965+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:22.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:22.945+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:22.994 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:22.989+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:23.951 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:23.945+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:24.021 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:24.013+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:24.961 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:24.953+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:25.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:25.021+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:25.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:25.989+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:26.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:26.033+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:27.026 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:27.021+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:27.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:27.049+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:28.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:28.037+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:28.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:28.065+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:28.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:28.993+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:29.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:29.069+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:30.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:29.997+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:30.038 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:30.029+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:30.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:30.981+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:31.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:31.029+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:31.940 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:31.933+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:32.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:32.029+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:32.921 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:32.913+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:33.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:32.993+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:33.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:33.885+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:33.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:33.965+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:34.931 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:34.925+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:34.969 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:34.961+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:35.886 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:35.881+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:36.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:36.009+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:36.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:36.837+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:37.065 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:37.057+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:37.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:37.833+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:38.027 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:38.021+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:38.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:38.841+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:39.010 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:39.005+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:39.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:39.889+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:39.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:39.973+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:40.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:40.925+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:40.943 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:40.937+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:41.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:41.913+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:41.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:41.969+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:42.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:42.925+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:42.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:42.981+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:43.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:43.957+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:43.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:43.969+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:44.928 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:44.921+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:44.943 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:44.937+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:45.921 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:45.913+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:45.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:45.965+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:46.897 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:46.889+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:47.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:47.005+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:47.895 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:47.889+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:48.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:48.001+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:48.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:48.845+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:49.015 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:49.009+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:49.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:49.841+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:50.036 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:50.029+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:50.873 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:50.865+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:51.056 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:51.049+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:51.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:51.901+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:52.010 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:52.005+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:52.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:52.889+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:53.010 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:53.005+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:53.873 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:53.865+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:53.991 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:53.985+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:54.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:54.885+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:55.003 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:54.997+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:55.927 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:55.921+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:55.971 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:55.965+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:56.951 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:56.945+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:57.021 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:57.013+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:57.973 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:57.965+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:58.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:58.053+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:59.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:59.013+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:22:59.065 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:22:59.057+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:22:59.992 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:22:59.985+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:00.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:00.021+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:01.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:01.013+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:01.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:01.021+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:02.052 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:02.045+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:02.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:02.053+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:03.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:03.009+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:03.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:03.073+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:04.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:04.029+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:04.053 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:04.049+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:05.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:05.061+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:05.079 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:05.073+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:06.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:06.077+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:06.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:06.113+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:07.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:07.077+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:07.107 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:07.101+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:08.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:08.081+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:08.122 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:08.117+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:09.097 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:09.089+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:09.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:09.105+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:10.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:10.049+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:10.133 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:10.125+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:11.015 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:11.009+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:11.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:11.101+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:12.036 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:12.029+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:12.145 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:12.137+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:12.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:12.985+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:13.124 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:13.117+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:14.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:14.013+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:14.128 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:14.121+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:14.973 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:14.965+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:15.090 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:15.085+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:15.961 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:15.953+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:16.055 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:16.049+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:16.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:16.933+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:17.033 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:17.025+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:17.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:17.909+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:18.078 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:18.073+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:18.867 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:18.861+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:19.094 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:19.089+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:19.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:19.909+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:20.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:20.101+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:20.962 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:20.957+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:21.125 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:21.117+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:21.987 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:21.981+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:22.094 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:22.089+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:23.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:23.005+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:23.099 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:23.093+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:23.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:23.961+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:24.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:24.077+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:24.946 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:24.941+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:25.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:25.057+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:25.992 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:25.985+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:26.088 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:26.081+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:27.037 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:27.029+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:27.041 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:27.037+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:28.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:28.021+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:28.077 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:28.069+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:29.059 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:29.053+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:29.061 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:29.057+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:30.049 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:30.045+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:30.097 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:30.089+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:31.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:31.029+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:31.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:31.081+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:32.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:32.073+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:32.113 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:32.109+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:33.065 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:33.061+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:33.089 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:33.081+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:34.052 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:34.045+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:34.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:34.061+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:35.051 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:35.045+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:35.065 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:35.057+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:36.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:36.085+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:36.097 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:36.093+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:37.107 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:37.101+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:37.131 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:37.125+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:38.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:38.085+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:38.142 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:38.137+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:39.101 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:39.097+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:39.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:39.185+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:40.147 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:40.141+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:40.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:40.189+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:41.183 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:41.177+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:41.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:41.181+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:42.223 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:42.217+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:42.227 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:42.221+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:43.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:43.205+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:43.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:43.249+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:44.212 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:44.205+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:44.269 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:44.265+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:45.249 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:45.241+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:45.301 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:45.297+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:46.299 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:46.293+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:46.301 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:46.297+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:47.256 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:47.249+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:47.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:47.301+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:48.237 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:48.233+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:48.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:48.345+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:49.250 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:49.245+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:49.361 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:49.353+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:50.250 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:50.245+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:50.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:50.377+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:51.255 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:51.249+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:51.365 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:51.357+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:52.239 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:52.233+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:52.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:52.373+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:53.250 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:53.245+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:53.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:53.397+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:54.261 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:54.257+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:54.430 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:54.425+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:55.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:55.305+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:55.407 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:55.401+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:56.342 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:56.337+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:56.369 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:56.365+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:57.326 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:57.321+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:57.359 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:57.353+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:58.351 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:58.345+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:58.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:58.377+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:23:59.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:23:59.305+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:23:59.419 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:23:59.413+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:00.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:00.265+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:00.458 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:00.453+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:01.236 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:01.229+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:01.494 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:01.489+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:02.245 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:02.241+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:02.467 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:02.461+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:03.279 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:03.273+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:03.495 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:03.489+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:04.305 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:04.301+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:04.545 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:04.541+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:05.355 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:05.349+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:05.556 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:05.549+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:06.343 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:06.337+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:06.599 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:06.593+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:07.319 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:07.313+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:07.608 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:07.601+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:08.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:08.281+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:08.641 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:08.637+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:09.331 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:09.325+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:09.601 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:09.597+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:10.366 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:10.361+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:10.556 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:10.549+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:11.334 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:11.329+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:11.542 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:11.537+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:12.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:12.293+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:12.536 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:12.529+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:13.269 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:13.261+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:13.519 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:13.513+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:14.317 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:14.313+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:14.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:14.561+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:15.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:15.265+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:15.586 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:15.581+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:16.310 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:16.305+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:16.629 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:16.625+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:17.302 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:17.297+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:17.584 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:17.577+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:18.257 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:18.249+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:18.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:18.589+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:19.304 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:19.297+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:19.584 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:19.577+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:20.258 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:20.253+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:20.569 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:20.565+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:21.290 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:21.285+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:21.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:21.557+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:22.242 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:22.237+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:22.600 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:22.593+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:23.267 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:23.261+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:23.554 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:23.549+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:24.271 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:24.265+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:24.558 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:24.553+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:25.297 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:25.293+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:25.561 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:25.557+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:26.258 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:26.253+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:26.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:26.541+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:27.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:27.229+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:27.545 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:27.541+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:28.232 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:28.225+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:28.569 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:28.565+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:29.271 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:29.265+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:29.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:29.541+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:30.279 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:30.273+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:30.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:30.585+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:31.307 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:31.301+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:31.572 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:31.565+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:32.273 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:32.269+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:32.553 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:32.549+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:33.264 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:33.257+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:33.591 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:33.585+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:34.253 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:34.249+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:34.551 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:34.545+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:35.244 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:35.237+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:35.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:35.533+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:36.262 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:36.257+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:36.497 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:36.493+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:37.233 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:37.229+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:37.452 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:37.445+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:38.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:38.265+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:38.456 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:38.449+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:39.273 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:39.269+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:39.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:39.429+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:40.234 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:40.229+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:40.479 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:40.473+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:41.244 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:41.237+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:41.448 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:41.445+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:42.198 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:42.193+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:42.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:42.481+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:43.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:43.149+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:43.490 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:43.485+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:44.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:44.185+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:44.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:44.473+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:45.220 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:45.213+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:45.521 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:45.517+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:46.253 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:46.249+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:46.517 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:46.513+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:47.283 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:47.277+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:47.543 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:47.537+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:48.256 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:48.249+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:48.515 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:48.509+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:49.262 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:49.257+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:49.479 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:49.473+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:50.258 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:50.253+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:50.481 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:50.477+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:51.220 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:51.213+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:51.512 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:51.505+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:52.225 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:52.221+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:52.496 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:52.489+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:53.246 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:53.241+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:53.510 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:53.505+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:54.215 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:54.209+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:54.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:54.509+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:55.246 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:55.241+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:55.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:55.513+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:56.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:56.281+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:56.532 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:56.525+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:57.248 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:57.241+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:57.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:57.557+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:58.295 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:58.289+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:58.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:58.597+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:24:59.335 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:24:59.329+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:24:59.632 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:24:59.625+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:00.289 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:00.285+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:00.617 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:00.613+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:01.313 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:01.309+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:01.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:01.585+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:02.281 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:02.277+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:02.636 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:02.633+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:03.315 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:03.309+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:03.674 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:03.669+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:04.303 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:04.297+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:04.686 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:04.681+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:05.281 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:05.277+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:05.676 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:05.669+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:06.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:06.237+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:06.691 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:06.685+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:07.194 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:07.189+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:07.669 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:07.665+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:08.146 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:08.141+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:08.681 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:08.677+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:09.101 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:09.097+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:09.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:09.701+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:10.124 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:10.117+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:10.744 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:10.737+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:11.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:11.085+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:11.750 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:11.745+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:12.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:12.105+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:12.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:12.793+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:13.117 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:13.113+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:13.842 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:13.837+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:14.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:14.105+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:14.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:14.869+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:15.090 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:15.085+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:15.900 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:15.897+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:16.055 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:16.049+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:16.858 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:16.853+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:17.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:17.065+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:17.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:17.809+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:18.058 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:18.053+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:18.773 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:18.769+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:19.099 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:19.093+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:19.786 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:19.781+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:20.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:20.081+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:20.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:20.817+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:21.050 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:21.045+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:21.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:21.801+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:22.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:22.001+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:22.764 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:22.761+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:23.035 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:23.029+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:23.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:23.733+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:24.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:23.997+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:24.753 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:24.749+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:25.054 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:25.049+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:25.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:25.797+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:26.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:26.053+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:26.804 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:26.801+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:27.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:27.081+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:27.767 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:27.761+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:28.086 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:28.081+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:28.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:28.741+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:29.119 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:29.113+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:29.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:29.701+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:30.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:30.109+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:30.669 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:30.665+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:31.147 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:31.141+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:31.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:31.681+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:32.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:32.181+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:32.730 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:32.725+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:33.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:33.185+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:33.748 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:33.741+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:34.237 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:34.233+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:34.747 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:34.741+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:35.190 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:35.185+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:35.732 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:35.729+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:36.216 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:36.213+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:36.770 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:36.765+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:37.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:37.237+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:37.820 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:37.813+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:38.249 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:38.245+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:38.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:38.773+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:39.280 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:39.277+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:39.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:39.797+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:40.273 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:40.269+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:40.832 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:40.829+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:41.321 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:41.317+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:41.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:41.813+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:42.319 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:42.313+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:42.781 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:42.777+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:43.353 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:43.349+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:43.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:43.809+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:44.352 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:44.349+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:44.777 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:44.773+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:45.357 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:45.353+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:45.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:45.793+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:46.404 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:46.401+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:46.841 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:46.837+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:47.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:47.369+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:47.812 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:47.809+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:48.409 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:48.405+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:48.797 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:48.793+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:49.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:49.405+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:49.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:49.781+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:50.414 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:50.409+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:50.798 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:50.793+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:51.408 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:51.405+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:51.769 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:51.765+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:52.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:52.453+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:52.788 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:52.781+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:53.426 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:53.421+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:53.765 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:53.761+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:54.431 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:54.425+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:54.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:54.729+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:55.469 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:55.465+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:55.781 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:55.777+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:56.444 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:56.437+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:56.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:56.805+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:57.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:57.449+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:57.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:57.789+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:58.442 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:58.437+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:58.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:58.837+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:25:59.477 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:25:59.473+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:25:59.882 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:25:59.877+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:00.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:00.461+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:00.885 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:00.881+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:01.505 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:01.501+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:01.918 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:01.913+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:02.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:02.465+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:02.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:02.961+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:03.480 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:03.477+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:03.950 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:03.945+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:04.432 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:04.425+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:04.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:04.973+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:05.419 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:05.413+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:06.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:05.997+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:06.376 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:06.373+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:06.988 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:06.985+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:07.365 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:07.361+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:07.954 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:07.949+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:08.375 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:08.369+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:09.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:08.997+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:09.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:09.369+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:10.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:09.997+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:10.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:10.333+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:10.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:10.957+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:11.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:11.373+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:11.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:11.909+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:12.423 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:12.417+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:12.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:12.949+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:13.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:13.465+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:13.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:13.993+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:14.512 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:14.509+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:14.991 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:14.985+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:15.534 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:15.529+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:16.029 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:16.025+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:16.494 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:16.489+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:17.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:17.029+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:17.504 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:17.501+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:18.029 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:18.025+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:18.458 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:18.453+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:19.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:19.013+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:19.506 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:19.501+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:20.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:20.013+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:20.536 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:20.533+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:21.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:21.025+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:21.510 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:21.505+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:21.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:21.977+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:22.533 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:22.529+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:23.025 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:23.021+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:23.491 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:23.485+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:24.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:24.021+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:24.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:24.461+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:25.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:25.005+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:25.428 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:25.425+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:26.048 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:26.041+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:26.406 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:26.401+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:27.087 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:27.081+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:27.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:27.397+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:28.063 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:28.057+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:28.398 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:28.393+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:29.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:29.085+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:29.422 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:29.417+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:30.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:30.065+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:30.451 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:30.445+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:31.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:31.093+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:31.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:31.437+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:32.128 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:32.125+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:32.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:32.425+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:33.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:33.085+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:33.389 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:33.385+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:34.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:34.101+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:34.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:34.405+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:35.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:35.125+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:35.374 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:35.369+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:36.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:36.149+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:36.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:36.357+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:37.154 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:37.149+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:37.371 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:37.365+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:38.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:38.153+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:38.385 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:38.381+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:39.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:39.153+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:39.423 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:39.417+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:40.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:40.157+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:40.443 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:40.437+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:41.156 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:41.153+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:41.455 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:41.449+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:42.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:42.197+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:42.461 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:42.453+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:43.229 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:43.225+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:43.496 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:43.493+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:44.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:44.177+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:44.536 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:44.533+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:45.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:45.153+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:45.535 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:45.529+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:46.110 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:46.105+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:46.571 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:46.565+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:47.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:47.137+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:47.571 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:47.565+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:48.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:48.165+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:48.573 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:48.569+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:49.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:49.129+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:49.554 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:49.549+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:50.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:50.117+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:50.562 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:50.557+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:51.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:51.085+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:51.568 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:51.565+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:52.133 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:52.129+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:52.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:52.601+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:53.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:53.085+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:53.607 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:53.601+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:54.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:54.069+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:54.580 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:54.577+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:55.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:55.097+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:55.573 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:55.569+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:56.136 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:56.133+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:56.568 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:56.565+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:57.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:57.181+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:57.600 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:57.597+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:58.183 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:58.177+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:58.638 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:58.633+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:26:59.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:26:59.137+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:26:59.661 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:26:59.657+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:00.154 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:00.149+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:00.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:00.669+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:01.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:01.165+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:01.720 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:01.717+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:02.169 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:02.165+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:02.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:02.749+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:03.197 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:03.193+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:03.739 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:03.733+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:04.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:04.233+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:04.712 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:04.709+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:05.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:05.273+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:05.668 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:05.665+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:06.260 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:06.257+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:06.691 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:06.689+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:07.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:07.233+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:07.689 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:07.685+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:08.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:08.249+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:08.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:08.721+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:09.278 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:09.273+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:09.729 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:09.725+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:10.252 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:10.249+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:10.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:10.773+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:11.258 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:11.253+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:11.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:11.749+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:12.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:12.265+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:12.720 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:12.717+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:13.249 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:13.245+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:13.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:13.701+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:14.208 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:14.205+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:14.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:14.677+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:15.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:15.181+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:15.732 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:15.729+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:16.167 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:16.161+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:16.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:16.769+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:17.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:17.137+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:17.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:17.761+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:18.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:18.165+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:18.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:18.805+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:19.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:19.201+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:19.820 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:19.813+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:20.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:20.181+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:20.814 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:20.809+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:21.148 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:21.145+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:21.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:21.785+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:22.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:22.157+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:22.833 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:22.829+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:23.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:23.121+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:23.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:23.845+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:24.151 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:24.145+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:24.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:24.805+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:25.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:25.137+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:25.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:25.789+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:26.159 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:26.157+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:26.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:26.809+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:27.118 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:27.113+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:27.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:27.793+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:28.102 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:28.097+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:28.762 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:28.757+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:29.117 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:29.113+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:29.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:29.721+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:30.113 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:30.109+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:30.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:30.713+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:31.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:31.129+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:31.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:31.737+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:32.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:32.137+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:32.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:32.749+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:33.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:33.121+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:33.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:33.797+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:34.105 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:34.101+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:34.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:34.757+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:35.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:35.077+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:35.788 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:35.785+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:36.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:36.117+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:36.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:36.753+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:37.152 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:37.149+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:37.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:37.713+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:38.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:38.193+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:38.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:38.753+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:39.193 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:39.189+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:39.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:39.753+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:40.180 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:40.177+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:40.787 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:40.781+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:41.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:41.141+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:41.829 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:41.825+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:42.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:42.189+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:42.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:42.829+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:43.173 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:43.169+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:43.813 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:43.809+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:44.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:44.161+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:44.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:44.837+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:45.147 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:45.145+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:45.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:45.829+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:46.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:46.117+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:46.794 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:46.789+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:47.077 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:47.073+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:47.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:47.789+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:48.102 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:48.097+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:48.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:48.753+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:49.101 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:49.097+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:49.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:49.801+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:50.133 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:50.129+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:50.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:50.849+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:51.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:51.137+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:51.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:51.825+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:52.157 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:52.153+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:52.788 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:52.785+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:53.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:53.193+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:53.764 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:53.761+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:54.224 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:54.221+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:54.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:54.749+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:55.219 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:55.213+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:55.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:55.733+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:56.183 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:56.177+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:56.690 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:56.685+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:57.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:57.137+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:57.733 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:57.729+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:58.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:58.137+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:58.714 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:58.709+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:27:59.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:27:59.101+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:27:59.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:27:59.661+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:00.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:00.081+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:00.706 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:00.701+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:01.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:01.065+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:01.714 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:01.709+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:02.040 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:02.037+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:02.743 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:02.737+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:03.056 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:03.053+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:03.789 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:03.785+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:04.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:04.085+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:04.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:04.825+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:05.133 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:05.129+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:05.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:05.817+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:06.161 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:06.157+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:06.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:06.853+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:07.206 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:07.201+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:07.853 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:07.849+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:08.248 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:08.245+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:08.814 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:08.809+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:09.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:09.261+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:09.862 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:09.857+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:10.257 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:10.253+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:10.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:10.905+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:11.298 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:11.293+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:11.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:11.893+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:12.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:12.261+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:12.894 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:12.889+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:13.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:13.229+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:13.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:13.857+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:14.252 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:14.249+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:14.885 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:14.881+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:15.268 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:15.265+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:15.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:15.925+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:16.228 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:16.225+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:16.889 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:16.885+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:17.224 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:17.221+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:17.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:17.913+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:18.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:18.265+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:18.891 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:18.889+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:19.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:19.229+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:19.904 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:19.901+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:20.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:20.197+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:20.941 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:20.937+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:21.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:21.193+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:21.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:21.897+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:22.244 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:22.241+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:22.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:22.921+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:23.292 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:23.289+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:23.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:23.973+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:24.314 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:24.309+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:24.971 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:24.969+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:25.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:25.293+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:26.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:26.017+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:26.299 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:26.297+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:27.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:27.017+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:27.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:27.325+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:27.980 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:27.977+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:28.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:28.349+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:29.025 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:29.021+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:29.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:29.309+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:30.032 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:30.029+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:30.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:30.293+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:31.060 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:31.057+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:31.256 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:31.253+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:32.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:32.033+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:32.248 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:32.245+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:33.083 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:33.077+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:33.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:33.257+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:34.097 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:34.093+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:34.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:34.257+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:35.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:35.121+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:35.247 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:35.245+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:36.149 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:36.145+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:36.214 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:36.209+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:37.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:37.109+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:37.222 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:37.217+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:38.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:38.097+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:38.217 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:38.213+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:39.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:39.081+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:39.266 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:39.261+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:40.050 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:40.045+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:40.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:40.229+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:41.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:41.013+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:41.271 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:41.269+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:42.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:42.001+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:42.314 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:42.309+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:43.054 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:43.049+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:43.310 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:43.305+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:44.093 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:44.089+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:44.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:44.289+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:45.053 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:45.049+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:45.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:45.313+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:46.095 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:46.089+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:46.308 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:46.305+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:47.071 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:47.069+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:47.358 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:47.353+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:48.070 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:48.065+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:48.358 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:48.353+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:49.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:49.017+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:49.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:49.313+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:50.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:50.025+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:50.297 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:50.293+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:51.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:51.069+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:51.344 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:51.341+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:52.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:52.037+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:52.313 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:52.309+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:53.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:53.081+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:53.305 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:53.301+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:54.075 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:54.069+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:54.326 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:54.321+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:55.082 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:55.077+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:55.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:55.317+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:56.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:56.081+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:56.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:56.316+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:57.075 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:57.072+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:57.274 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:57.268+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:58.115 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:58.108+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:58.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:58.288+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:28:59.067 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:28:59.064+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:28:59.332 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:28:59.328+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:00.046 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:00.040+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:00.352 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:00.348+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:00.998 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:00.992+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:01.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:01.392+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:01.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:01.992+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:02.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:02.400+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:02.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:02.996+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:03.410 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:03.404+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:04.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:03.996+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:04.410 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:04.404+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:04.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:04.968+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:05.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:05.412+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:05.984 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:05.980+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:06.429 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:06.424+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:06.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:06.964+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:07.387 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:07.384+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:07.938 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:07.932+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:08.394 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:08.388+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:08.971 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:08.964+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:09.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:09.428+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:10.008 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:10.004+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:10.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:10.464+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:11.031 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:11.028+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:11.431 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:11.428+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:12.079 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:12.076+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:12.389 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:12.384+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:13.054 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:13.048+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:13.346 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:13.340+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:14.007 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:14.000+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:14.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:14.352+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:14.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:14.976+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:15.405 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:15.400+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:16.011 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:16.008+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:16.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:16.388+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:16.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:16.984+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:17.370 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:17.364+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:17.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:17.940+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:18.386 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:18.380+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:18.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:18.928+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:19.398 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:19.392+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:19.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:19.896+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:20.402 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:20.396+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:20.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:20.880+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:21.362 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:21.356+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:21.840 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:21.836+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:22.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:22.392+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:22.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:22.848+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:23.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:23.432+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:23.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:23.812+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:24.394 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:24.388+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:24.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:24.828+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:25.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:25.408+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:25.839 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:25.836+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:26.404 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:26.400+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:26.842 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:26.836+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:27.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:27.396+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:27.806 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:27.800+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:28.359 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:28.352+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:28.775 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:28.772+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:29.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:29.384+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:29.780 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:29.776+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:30.424 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:30.420+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:30.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:30.760+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:31.411 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:31.408+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:31.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:31.772+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:32.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:32.408+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:32.777 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:32.772+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:33.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:33.368+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:33.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:33.792+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:34.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:34.344+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:34.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:34.796+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:35.304 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:35.300+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:35.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:35.820+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:36.297 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:36.292+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:36.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:36.804+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:37.330 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:37.324+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:37.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:37.808+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:38.346 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:38.340+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:38.818 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:38.812+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:39.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:39.348+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:39.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:39.792+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:40.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:40.344+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:40.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:40.780+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:41.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:41.348+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:41.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:41.792+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:42.321 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:42.316+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:42.758 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:42.752+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:43.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:43.328+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:43.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:43.792+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:44.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:44.344+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:44.772 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:44.768+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:45.359 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:45.356+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:45.768 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:45.764+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:46.338 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:46.332+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:46.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:46.724+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:47.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:47.312+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:47.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:47.712+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:48.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:48.276+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:48.728 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:48.724+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:49.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:49.272+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:49.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:49.712+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:50.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:50.272+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:50.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:50.664+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:51.320 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:51.316+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:51.631 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:51.628+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:52.272 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:52.268+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:52.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:52.652+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:53.289 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:53.284+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:53.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:53.672+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:54.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:54.264+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:54.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:54.700+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:55.232 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:55.228+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:55.659 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:55.656+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:56.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:56.256+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:56.629 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:56.624+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:57.284 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:57.280+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:57.646 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:57.640+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:58.287 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:58.284+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:58.691 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:58.688+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:29:59.305 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:29:59.300+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:29:59.693 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:29:59.688+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:00.340 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:00.336+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:00.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:00.720+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:01.349 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:01.344+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:01.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:01.696+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:02.320 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:02.316+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:02.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:02.724+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:03.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:03.280+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:03.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:03.772+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:04.321 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:04.316+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:04.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:04.752+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:05.359 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:05.356+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:05.727 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:05.720+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:06.322 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:06.316+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:06.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:06.712+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:07.283 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:07.280+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:07.687 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:07.680+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:08.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:08.232+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:08.641 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:08.636+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:09.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:09.260+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:09.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:09.628+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:10.216 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:10.212+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:10.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:10.628+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:11.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:11.176+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:11.672 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:11.668+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:12.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:12.160+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:12.664 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:12.660+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:13.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:13.184+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:13.694 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:13.688+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:14.197 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:14.192+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:14.709 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:14.704+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:15.154 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:15.148+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:15.754 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:15.748+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:16.183 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:16.180+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:16.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:16.788+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:17.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:17.132+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:17.813 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:17.808+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:18.118 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:18.112+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:18.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:18.812+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:19.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:19.116+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:19.770 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:19.764+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:20.154 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:20.148+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:20.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:20.796+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:21.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:21.132+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:21.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:21.792+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:22.123 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:22.120+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:22.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:22.760+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:23.137 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:23.132+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:23.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:23.788+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:24.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:24.136+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:24.753 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:24.748+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:25.172 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:25.168+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:25.728 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:25.724+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:26.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:26.152+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:26.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:26.692+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:27.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:27.132+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:27.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:27.712+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:28.123 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:28.120+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:28.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:28.760+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:29.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:29.084+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:29.812 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:29.808+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:30.094 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:30.088+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:30.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:30.824+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:31.069 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:31.064+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:31.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:31.804+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:32.110 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:32.104+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:32.788 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:32.784+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:33.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:33.076+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:33.746 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:33.740+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:34.064 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:34.060+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:34.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:34.732+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:35.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:35.028+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:35.739 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:35.732+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:36.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:35.996+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:36.736 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:36.732+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:37.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:37.020+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:37.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:37.756+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:38.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:38.024+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:38.805 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:38.800+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:39.010 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:39.004+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:39.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:39.824+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:39.971 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:39.964+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:40.857 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:40.852+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:40.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:40.924+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:41.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:41.832+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:41.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:41.940+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:42.866 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:42.860+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:42.969 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:42.964+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:43.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:43.828+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:43.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:43.936+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:44.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:44.856+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:44.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:44.944+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:45.912 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:45.908+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:45.962 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:45.956+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:46.920 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:46.916+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:46.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:46.976+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:47.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:47.872+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:47.984 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:47.980+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:48.874 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:48.868+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:48.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:48.944+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:49.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:49.848+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:49.918 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:49.912+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:50.875 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:50.868+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:50.920 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:50.916+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:51.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:51.840+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:51.936 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:51.932+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:52.812 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:52.808+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:52.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:52.976+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:53.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:53.792+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:54.012 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:54.008+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:54.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:54.768+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:54.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:54.976+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:55.732 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:55.728+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:56.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:55.995+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:56.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:56.743+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:56.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:56.971+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:57.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:57.699+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:57.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:57.959+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:58.684 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:58.679+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:30:58.969 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:58.963+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:30:59.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:30:59.707+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:00.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:30:59.995+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:00.692 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:00.687+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:01.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:01.035+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:01.662 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:01.655+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:02.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:02.051+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:02.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:02.675+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:03.056 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:03.051+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:03.724 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:03.719+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:04.096 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:04.091+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:04.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:04.695+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:05.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:05.083+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:05.742 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:05.735+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:06.065 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:06.059+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:06.754 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:06.747+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:07.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:07.075+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:07.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:07.787+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:08.119 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:08.111+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:08.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:08.823+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:09.100 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:09.095+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:09.866 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:09.859+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:10.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:10.131+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:10.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:10.819+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:11.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:11.135+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:11.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:11.795+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:12.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:12.091+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:12.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:12.823+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:13.131 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:13.123+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:13.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:13.807+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:14.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:14.095+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:14.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:14.803+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:15.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:15.083+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:15.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:15.767+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:16.063 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:16.059+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:16.787 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:16.779+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:17.073 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:17.067+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:17.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:17.755+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:18.065 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:18.059+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:18.771 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:18.767+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:19.110 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:19.103+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:19.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:19.803+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:20.105 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:20.099+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:20.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:20.803+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:21.069 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:21.063+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:21.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:21.807+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:22.037 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:22.031+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:22.860 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:22.855+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:23.014 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:23.007+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:23.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:23.827+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:23.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:23.971+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:24.859 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:24.855+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:24.933 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:24.927+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:25.877 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:25.871+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:25.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:25.959+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:26.888 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:26.883+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:26.980 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:26.975+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:27.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:27.843+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:28.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:28.023+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:28.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:28.843+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:29.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:29.027+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:29.814 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:29.807+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:30.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:30.023+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:30.772 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:30.767+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:31.029 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:31.023+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:31.777 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:31.771+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:32.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:32.047+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:32.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:32.791+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:33.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:33.039+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:33.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:33.771+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:34.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:34.051+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:34.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:34.791+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:35.076 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:35.071+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:35.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:35.803+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:36.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:36.067+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:36.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:36.855+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:37.029 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:37.023+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:37.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:37.819+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:37.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:37.983+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:38.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:38.843+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:38.998 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:38.991+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:39.876 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:39.871+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:39.967 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:39.963+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:40.906 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:40.899+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:40.995 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:40.987+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:41.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:41.871+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:41.946 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:41.939+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:42.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:42.903+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:42.962 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:42.955+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:43.909 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:43.903+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:43.946 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:43.939+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:44.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:44.887+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:44.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:44.971+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:45.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:45.867+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:45.977 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:45.971+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:46.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:46.863+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:46.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:46.927+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:47.901 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:47.895+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:47.973 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:47.967+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:48.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:48.891+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:48.961 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:48.955+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:49.853 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:49.847+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:50.003 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:49.999+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:50.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:50.883+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:50.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:50.959+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:51.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:51.851+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:51.960 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:51.955+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:52.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:52.819+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:53.004 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:52.999+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:53.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:53.843+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:54.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:54.043+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:54.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:54.863+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:55.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:55.067+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:55.914 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:55.907+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:56.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:56.039+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:56.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:56.879+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:57.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:57.039+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:57.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:57.835+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:58.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:58.063+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:58.838 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:58.831+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:31:59.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:31:59.071+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:31:59.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:31:59.811+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:00.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:00.075+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:00.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:00.767+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:01.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:01.107+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:01.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:01.743+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:02.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:02.135+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:02.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:02.775+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:03.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:03.159+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:03.813 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:03.807+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:04.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:04.131+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:04.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:04.803+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:05.137 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:05.131+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:05.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:05.811+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:06.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:06.111+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:06.867 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:06.863+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:07.096 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:07.091+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:07.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:07.811+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:08.099 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:08.091+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:08.840 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:08.835+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:09.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:09.087+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:09.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:09.787+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:10.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:10.139+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:10.820 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:10.815+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:11.119 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:11.111+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:11.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:11.851+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:12.110 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:12.103+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:12.859 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:12.855+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:13.096 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:13.091+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:13.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:13.815+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:14.145 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:14.139+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:14.845 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:14.839+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:15.151 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:15.143+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:15.865 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:15.859+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:16.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:16.155+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:16.885 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:16.879+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:17.171 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:17.163+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:17.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:17.927+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:18.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:18.183+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:18.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:18.911+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:19.215 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:19.207+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:19.906 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:19.899+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:20.235 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:20.227+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:20.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:20.947+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:21.280 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:21.275+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:21.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:21.927+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:22.272 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:22.267+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:22.887 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:22.883+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:23.321 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:23.315+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:23.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:23.883+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:24.287 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:24.283+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:24.939 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:24.935+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:25.274 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:25.267+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:25.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:25.967+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:26.300 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:26.295+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:26.931 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:26.923+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:27.299 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:27.291+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:27.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:27.883+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:28.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:28.247+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:28.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:28.863+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:29.218 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:29.211+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:29.854 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:29.846+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:30.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:30.174+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:30.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:30.866+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:31.137 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:31.130+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:31.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:31.862+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:32.177 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:32.170+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:32.850 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:32.842+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:33.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:33.134+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:33.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:33.862+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:34.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:34.114+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:34.840 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:34.834+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:35.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:35.154+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:35.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:35.866+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:36.197 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:36.190+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:36.887 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:36.882+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:37.246 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:37.238+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:37.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:37.886+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:38.293 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:38.286+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:38.920 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:38.914+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:39.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:39.254+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:39.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:39.954+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:40.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:40.270+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:40.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:40.990+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:41.243 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:41.234+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:41.986 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:41.978+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:42.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:42.286+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:42.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:42.958+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:43.268 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:43.262+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:43.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:43.910+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:44.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:44.306+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:44.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:44.946+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:45.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:45.342+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:45.995 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:45.990+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:46.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:46.342+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:47.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:47.038+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:47.305 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:47.298+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:48.020 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:48.014+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:48.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:48.314+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:49.048 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:49.042+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:49.310 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:49.302+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:50.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:50.078+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:50.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:50.262+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:51.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:51.086+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:51.249 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:51.242+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:52.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:52.110+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:52.201 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:52.194+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:53.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:53.102+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:53.171 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:53.162+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:54.145 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:54.138+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:54.209 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:54.202+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:55.101 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:55.094+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:55.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:55.250+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:56.100 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:56.094+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:56.244 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:56.238+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:57.120 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:57.114+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:57.206 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:57.198+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:58.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:58.158+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:58.241 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:58.234+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:32:59.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:32:59.146+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:32:59.268 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:32:59.262+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:00.149 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:00.142+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:00.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:00.294+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:01.141 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:01.134+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:01.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:01.270+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:02.159 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:02.154+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:02.248 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:02.242+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:03.148 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:03.142+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:03.299 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:03.290+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:04.177 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:04.170+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:04.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:04.270+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:05.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:05.214+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:05.272 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:05.266+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:06.249 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:06.242+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:06.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:06.314+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:07.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:07.214+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:07.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:07.318+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:08.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:08.266+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:08.284 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:08.278+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:09.264 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:09.258+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:09.313 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:09.306+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:10.290 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:10.282+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:10.363 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:10.354+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:11.332 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:11.326+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:11.345 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:11.338+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:12.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:12.302+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:12.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:12.322+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:13.357 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:13.350+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:13.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:13.354+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:14.339 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:14.334+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:14.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:14.398+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:15.355 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:15.350+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:15.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:15.358+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:16.343 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:16.334+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:16.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:16.398+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:17.361 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:17.354+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:17.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:17.394+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:18.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:18.322+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:18.396 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:18.390+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:19.333 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:19.326+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:19.415 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:19.406+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:20.357 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:20.350+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:20.383 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:20.378+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:21.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:21.322+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:21.342 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:21.334+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:22.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:22.330+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:22.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:22.350+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:23.303 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:23.298+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:23.373 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:23.366+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:24.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:24.338+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:24.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:24.362+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:25.315 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:25.306+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:25.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:25.374+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:26.353 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:26.346+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:26.354 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:26.346+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:27.368 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:27.362+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:27.382 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:27.374+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:28.390 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:28.382+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:28.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:28.390+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:29.372 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:29.366+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:29.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:29.394+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:30.327 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:30.318+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:30.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:30.374+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:31.327 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:31.318+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:31.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:31.394+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:32.305 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:32.298+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:32.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:32.382+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:33.286 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:33.278+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:33.404 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:33.398+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:34.284 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:34.278+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:34.449 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:34.442+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:35.281 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:35.274+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:35.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:35.430+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:36.277 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:36.270+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:36.420 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:36.414+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:37.327 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:37.318+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:37.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:37.390+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:38.293 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:38.286+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:38.378 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:38.370+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:39.321 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:39.314+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:39.418 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:39.410+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:40.302 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:40.294+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:40.381 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:40.374+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:41.350 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:41.342+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:41.405 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:41.398+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:42.330 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:42.322+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:42.392 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:42.386+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:43.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:43.282+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:43.387 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:43.378+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:44.257 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:44.250+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:44.433 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:44.426+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:45.264 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:45.254+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:45.429 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:45.422+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:46.260 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:46.254+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:46.386 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:46.378+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:47.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:47.226+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:47.344 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:47.338+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:48.245 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:48.238+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:48.394 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:48.386+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:49.266 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:49.258+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:49.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:49.362+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:50.303 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:50.294+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:50.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:50.374+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:51.261 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:51.254+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:51.338 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:51.330+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:52.225 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:52.218+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:52.367 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:52.358+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:53.267 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:53.258+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:53.342 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:53.333+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:54.290 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:54.281+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:54.352 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:54.345+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:55.258 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:55.249+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:55.316 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:55.309+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:56.297 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:56.289+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:56.298 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:56.289+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:57.284 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:57.277+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:57.349 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:57.341+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:58.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:58.281+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:58.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:58.377+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:33:59.302 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:33:59.293+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:33:59.419 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:33:59.409+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:00.290 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:00.285+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:00.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:00.461+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:01.265 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:01.261+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:01.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:01.417+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:02.252 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:02.245+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:02.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:02.393+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:03.261 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:03.257+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:03.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:03.377+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:04.283 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:04.281+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:04.419 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:04.413+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:05.330 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:05.325+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:05.456 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:05.453+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:06.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:06.305+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:06.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:06.433+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:07.343 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:07.337+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:07.444 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:07.441+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:08.362 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:08.357+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:08.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:08.437+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:09.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:09.333+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:09.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:09.425+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:10.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:10.369+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:10.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:10.417+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:11.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:11.325+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:11.455 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:11.449+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:12.366 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:12.361+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:12.490 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:12.485+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:13.368 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:13.365+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:13.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:13.457+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:14.340 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:14.337+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:14.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:14.449+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:15.370 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:15.365+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:15.488 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:15.485+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:16.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:16.417+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:16.499 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:16.489+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:17.430 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:17.425+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:17.508 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:17.501+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:18.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:18.409+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:18.508 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:18.505+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:19.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:19.377+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:19.514 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:19.509+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:20.425 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:20.421+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:20.497 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:20.493+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:21.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:21.393+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:21.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:21.449+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:22.416 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:22.413+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:22.477 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:22.473+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:23.398 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:23.393+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:23.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:23.521+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:24.410 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:24.405+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:24.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:24.573+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:25.454 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:25.449+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:25.610 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:25.605+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:26.500 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:26.497+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:26.586 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:26.581+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:27.500 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:27.497+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:27.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:27.629+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:28.506 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:28.501+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:28.651 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:28.645+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:29.555 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:29.549+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:29.622 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:29.617+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:30.562 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:30.557+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:30.657 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:30.653+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:31.588 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:31.585+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:31.649 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:31.645+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:32.617 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:32.613+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:32.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:32.653+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:33.599 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:33.593+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:33.619 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:33.613+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:34.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:34.585+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:34.604 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:34.601+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:35.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:35.557+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:35.594 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:35.589+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:36.532 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:36.529+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:36.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:36.561+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:37.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:37.497+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:37.521 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:37.517+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:38.535 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:38.529+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:38.540 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:38.537+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:39.498 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:39.493+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:39.506 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:39.501+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:40.498 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:40.493+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:40.530 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:40.525+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:41.460 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:41.457+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:41.529 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:41.525+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:42.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:42.429+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:42.497 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:42.493+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:43.455 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:43.449+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:43.465 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:43.461+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:44.473 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:44.469+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:44.492 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:44.489+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:45.458 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:45.453+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:45.459 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:45.453+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:46.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:46.425+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:46.503 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:46.501+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:47.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:47.397+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:47.487 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:47.481+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:48.437 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:48.433+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:48.509 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:48.505+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:49.419 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:49.417+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:49.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:49.477+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:50.406 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:50.401+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:50.450 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:50.445+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:51.419 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:51.413+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:51.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:51.453+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:52.378 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:52.373+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:52.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:52.433+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:53.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:53.345+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:53.419 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:53.413+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:54.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:54.373+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:54.409 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:54.405+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:55.367 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:55.361+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:55.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:55.389+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:56.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:56.341+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:56.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:56.373+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:57.385 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:57.381+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:57.427 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:57.421+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:58.368 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:58.365+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:58.464 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:58.457+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:34:59.341 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:34:59.337+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:34:59.447 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:34:59.441+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:00.350 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:00.345+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:00.431 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:00.425+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:01.367 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:01.361+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:01.439 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:01.433+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:02.375 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:02.369+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:02.414 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:02.409+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:03.409 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:03.405+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:03.439 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:03.437+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:04.397 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:04.393+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:04.448 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:04.445+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:05.407 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:05.401+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:05.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:05.481+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:06.385 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:06.381+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:06.515 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:06.509+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:07.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:07.357+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:07.505 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:07.501+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:08.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:08.341+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:08.536 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:08.533+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:09.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:09.353+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:09.489 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:09.485+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:10.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:10.357+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:10.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:10.453+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:11.339 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:11.337+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:11.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:11.437+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:12.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:12.297+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:12.479 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:12.473+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:13.257 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:13.253+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:13.511 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:13.505+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:14.242 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:14.237+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:14.481 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:14.477+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:15.273 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:15.269+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:15.531 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:15.525+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:16.246 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:16.241+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:16.524 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:16.521+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:17.294 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:17.289+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:17.499 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:17.497+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:18.253 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:18.249+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:18.506 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:18.501+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:19.222 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:19.217+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:19.550 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:19.545+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:20.225 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:20.221+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:20.511 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:20.505+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:21.232 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:21.229+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:21.479 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:21.473+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:22.224 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:22.221+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:22.482 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:22.477+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:23.177 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:23.173+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:23.516 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:23.513+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:24.226 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:24.221+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:24.523 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:24.517+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:25.243 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:25.237+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:25.546 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:25.541+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:26.248 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:26.245+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:26.534 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:26.529+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:27.240 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:27.233+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:27.524 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:27.521+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:28.232 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:28.229+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:28.574 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:28.569+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:29.243 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:29.237+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:29.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:29.613+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:30.212 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:30.209+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:30.639 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:30.633+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:31.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:31.237+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:31.621 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:31.617+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:32.269 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:32.265+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:32.585 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:32.581+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:33.234 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:33.229+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:33.611 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:33.605+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:34.202 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:34.197+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:34.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:34.589+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:35.221 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:35.217+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:35.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:35.609+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:36.189 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:36.185+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:36.662 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:36.657+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:37.209 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:37.205+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:37.659 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:37.657+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:38.236 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:38.233+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:38.617 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:38.613+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:39.286 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:39.281+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:39.633 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:39.629+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:40.335 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:40.329+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:40.630 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:40.625+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:41.363 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:41.357+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:41.681 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:41.677+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:42.388 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:42.385+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:42.702 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:42.697+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:43.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:43.353+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:43.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:43.733+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:44.336 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:44.333+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:44.710 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:44.705+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:45.347 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:45.341+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:45.738 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:45.733+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:46.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:46.333+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:46.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:46.781+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:47.376 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:47.373+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:47.812 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:47.809+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:48.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:48.373+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:48.857 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:48.853+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:49.350 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:49.344+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:49.842 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:49.836+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:50.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:50.372+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:50.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:50.788+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:51.396 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:51.392+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:51.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:51.800+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:52.400 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:52.396+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:52.781 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:52.776+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:53.435 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:53.428+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:53.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:53.820+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:54.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:54.456+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:54.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:54.792+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:55.491 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:55.484+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:55.782 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:55.776+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:56.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:56.452+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:56.775 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:56.768+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:57.478 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:57.472+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:57.773 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:57.768+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:58.524 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:58.520+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:58.759 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:58.752+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:35:59.515 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:35:59.508+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:35:59.731 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:35:59.728+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:00.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:00.532+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:00.698 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:00.692+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:01.565 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:01.560+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:01.678 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:01.672+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:02.609 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:02.604+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:02.652 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:02.648+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:03.645 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:03.640+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:03.695 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:03.688+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:04.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:04.660+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:04.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:04.736+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:05.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:05.668+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:05.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:05.736+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:06.633 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:06.628+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:06.709 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:06.704+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:07.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:07.628+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:07.689 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:07.684+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:08.592 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:08.584+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:08.685 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:08.680+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:09.590 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:09.584+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:09.685 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:09.680+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:10.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:10.556+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:10.685 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:10.680+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:11.603 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:11.600+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:11.659 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:11.656+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:12.572 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:12.568+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:12.654 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:12.648+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:13.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:13.552+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:13.635 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:13.632+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:14.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:14.520+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:14.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:14.620+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:15.512 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:15.508+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:15.605 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:15.600+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:16.508 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:16.504+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:16.632 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:16.628+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:17.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:17.532+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:17.610 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:17.604+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:18.563 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:18.556+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:18.584 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:18.580+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:19.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:19.544+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:19.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:19.628+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:20.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:20.572+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:20.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:20.664+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:21.595 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:21.588+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:21.631 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:21.624+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:22.640 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:22.636+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:22.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:22.664+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:23.667 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:23.664+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:23.681 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:23.676+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:24.665 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:24.660+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:24.712 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:24.708+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:25.697 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:25.692+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:25.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:25.700+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:26.676 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:26.672+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:26.690 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:26.684+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:27.696 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:27.692+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:27.729 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:27.724+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:28.714 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:28.708+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:28.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:28.732+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:29.673 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:29.668+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:29.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:29.728+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:30.723 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:30.716+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:30.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:30.732+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:31.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:31.700+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:31.713 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:31.708+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:32.733 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:32.728+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:32.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:32.740+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:33.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:33.732+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:33.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:33.736+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:34.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:34.692+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:34.710 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:34.704+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:35.671 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:35.664+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:35.705 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:35.700+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:36.671 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:36.664+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:36.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:36.700+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:37.700 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:37.696+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:37.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:37.704+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:38.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:38.724+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:38.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:38.744+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:39.713 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:39.708+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:39.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:39.720+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:40.680 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:40.676+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:40.700 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:40.696+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:41.695 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:41.688+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:41.721 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:41.716+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:42.676 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:42.672+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:42.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:42.732+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:43.635 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:43.628+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:43.782 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:43.776+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:44.623 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:44.616+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:44.759 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:44.752+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:45.580 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:45.576+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:45.751 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:45.748+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:46.567 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:46.560+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:46.747 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:46.740+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:47.551 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:47.544+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:47.733 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:47.728+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:48.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:48.524+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:48.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:48.700+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:49.574 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:49.568+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:49.740 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:49.736+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:50.570 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:50.564+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:50.716 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:50.712+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:51.616 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:51.612+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:51.730 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:51.724+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:52.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:52.628+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:52.727 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:52.720+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:53.658 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:53.652+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:53.747 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:53.740+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:54.615 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:54.608+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:54.742 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:54.736+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:55.586 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:55.580+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:55.789 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:55.784+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:56.630 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:56.624+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:56.777 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:56.772+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:57.665 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:57.660+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:57.751 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:57.744+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:58.662 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:58.656+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:58.706 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:58.700+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:36:59.648 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:36:59.644+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:36:59.692 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:36:59.688+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:00.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:00.628+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:00.715 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:00.712+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:01.595 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:01.588+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:01.733 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:01.728+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:02.595 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:02.588+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:02.696 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:02.692+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:03.638 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:03.632+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:03.654 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:03.648+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:04.661 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:04.656+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:04.687 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:04.680+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:05.658 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:05.652+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:05.685 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:05.680+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:06.694 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:06.688+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:06.708 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:06.704+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:07.697 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:07.692+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:07.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:07.700+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:08.673 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:08.668+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:08.734 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:08.728+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:09.681 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:09.676+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:09.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:09.704+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:10.647 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:10.644+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:10.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:10.700+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:11.661 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:11.656+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:11.721 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:11.716+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:12.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:12.608+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:12.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:12.692+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:13.568 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:13.564+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:13.651 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:13.644+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:14.544 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:14.540+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:14.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:14.696+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:15.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:15.508+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:15.658 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:15.652+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:16.542 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:16.536+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:16.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:16.664+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:17.553 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:17.548+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:17.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:17.692+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:18.549 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:18.544+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:18.706 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:18.700+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:19.552 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:19.548+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:19.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:19.700+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:20.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:20.520+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:20.676 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:20.672+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:21.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:21.532+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:21.722 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:21.716+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:22.500 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:22.496+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:22.692 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:22.688+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:23.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:23.480+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:23.699 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:23.692+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:24.492 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:24.488+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:24.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:24.664+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:25.454 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:25.448+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:25.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:25.672+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:26.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:26.436+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:26.663 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:26.660+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:27.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:27.452+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:27.645 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:27.640+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:28.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:28.416+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:28.662 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:28.656+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:29.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:29.368+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:29.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:29.672+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:30.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:30.380+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:30.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:30.696+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:31.365 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:31.360+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:31.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:31.744+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:32.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:32.368+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:32.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:32.784+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:33.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:33.380+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:33.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:33.736+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:34.389 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:34.384+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:34.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:34.788+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:35.370 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:35.364+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:35.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:35.768+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:36.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:36.384+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:36.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:36.756+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:37.370 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:37.364+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:37.746 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:37.740+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:38.411 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:38.404+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:38.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:38.792+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:39.429 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:39.424+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:39.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:39.840+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:40.455 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:40.452+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:40.802 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:40.796+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:41.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:41.436+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:41.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:41.788+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:42.489 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:42.484+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:42.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:42.788+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:43.526 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:43.520+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:43.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:43.828+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:44.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:44.560+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:44.838 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:44.831+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:45.594 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:45.587+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:45.794 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:45.787+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:46.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:46.567+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:46.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:46.787+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:47.572 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:47.567+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:47.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:47.831+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:48.526 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:48.519+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:48.821 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:48.815+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:49.540 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:49.535+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:49.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:49.811+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:50.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:50.559+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:50.794 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:50.787+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:51.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:51.559+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:51.783 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:51.775+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:52.562 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:52.555+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:52.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:52.775+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:53.549 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:53.543+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:53.770 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:53.763+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:54.547 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:54.539+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:54.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:54.787+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:55.529 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:55.523+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:55.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:55.803+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:56.487 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:56.479+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:56.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:56.795+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:57.507 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:57.499+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:57.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:57.799+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:58.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:58.479+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:58.762 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:58.755+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:37:59.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:37:59.463+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:37:59.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:37:59.751+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:00.469 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:00.463+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:00.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:00.751+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:01.492 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:01.487+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:01.743 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:01.739+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:02.475 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:02.467+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:02.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:02.703+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:03.510 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:03.503+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:03.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:03.695+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:04.509 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:04.503+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:04.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:04.723+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:05.557 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:05.551+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:05.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:05.739+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:06.594 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:06.587+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:06.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:06.787+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:07.602 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:07.595+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:07.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:07.811+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:08.635 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:08.627+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:08.800 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:08.795+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:09.669 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:09.663+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:09.788 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:09.783+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:10.662 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:10.655+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:10.749 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:10.743+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:11.678 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:11.671+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:11.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:11.775+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:12.651 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:12.643+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:12.818 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:12.811+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:13.695 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:13.687+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:13.802 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:13.795+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:14.729 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:14.723+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:14.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:14.791+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:15.710 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:15.703+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:15.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:15.799+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:16.686 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:16.679+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:16.761 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:16.755+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:17.643 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:17.635+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:17.721 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:17.715+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:18.612 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:18.607+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:18.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:18.759+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:19.574 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:19.567+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:19.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:19.739+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:20.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:20.595+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:20.775 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:20.767+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:21.635 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:21.631+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:21.734 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:21.727+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:22.617 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:22.611+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:22.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:22.711+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:23.647 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:23.639+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:23.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:23.711+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:24.622 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:24.615+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:24.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:24.739+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:25.663 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:25.655+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:25.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:25.751+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:26.621 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:26.615+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:26.761 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:26.755+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:27.610 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:27.603+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:27.748 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:27.743+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:28.570 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:28.563+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:28.748 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:28.739+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:29.542 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:29.535+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:29.746 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:29.739+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:30.558 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:30.551+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:30.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:30.699+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:31.571 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:31.563+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:31.659 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:31.651+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:32.585 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:32.579+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:32.685 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:32.675+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:33.568 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:33.563+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:33.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:33.711+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:34.565 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:34.559+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:34.729 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:34.723+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:35.533 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:35.527+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:35.728 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:35.723+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:36.573 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:36.567+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:36.699 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:36.691+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:37.528 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:37.523+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:37.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:37.719+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:38.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:38.507+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:38.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:38.751+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:39.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:39.543+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:39.729 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:39.723+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:40.560 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:40.555+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:40.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:40.707+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:41.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:41.571+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:41.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:41.751+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:42.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:42.583+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:42.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:42.791+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:43.633 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:43.627+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:43.770 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:43.763+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:44.669 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:44.663+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:44.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:44.779+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:45.679 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:45.671+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:45.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:45.759+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:46.650 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:46.643+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:46.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:46.771+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:47.699 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:47.691+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:47.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:47.803+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:48.730 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:48.723+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:48.863 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:48.855+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:49.686 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:49.679+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:49.886 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:49.879+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:50.648 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:50.643+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:50.895 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:50.891+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:51.671 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:51.663+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:51.886 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:51.879+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:52.719 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:52.711+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:52.853 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:52.847+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:53.691 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:53.683+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:53.889 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:53.883+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:54.697 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:54.691+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:54.937 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:54.931+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:55.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:55.735+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:55.924 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:55.919+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:56.767 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:56.759+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:56.943 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:56.935+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:57.759 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:57.751+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:57.946 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:57.939+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:58.719 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:58.711+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:58.976 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:58.971+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:38:59.761 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:38:59.755+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:38:59.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:38:59.983+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:00.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:00.771+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:00.958 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:00.951+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:01.759 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:01.751+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:02.005 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:01.999+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:02.730 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:02.723+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:03.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:02.999+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:03.728 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:03.723+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:03.992 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:03.987+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:04.702 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:04.695+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:05.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:05.007+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:05.701 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:05.695+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:05.995 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:05.987+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:06.748 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:06.743+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:07.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:07.007+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:07.715 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:07.707+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:08.007 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:07.999+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:08.682 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:08.675+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:08.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:08.963+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:09.642 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:09.635+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:09.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:09.983+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:10.629 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:10.623+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:10.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:10.955+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:11.642 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:11.635+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:11.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:11.923+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:12.627 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:12.619+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:12.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:12.911+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:13.584 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:13.579+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:13.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:13.927+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:14.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:14.611+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:14.975 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:14.967+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:15.600 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:15.595+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:15.957 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:15.951+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:16.610 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:16.603+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:16.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:16.911+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:17.659 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:17.651+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:17.874 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:17.867+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:18.703 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:18.695+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:18.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:18.851+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:19.661 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:19.655+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:19.888 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:19.883+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:20.641 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:20.634+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:20.888 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:20.882+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:21.668 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:21.662+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:21.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:21.926+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:22.695 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:22.686+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:22.942 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:22.934+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:23.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:23.726+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:23.937 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:23.930+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:24.709 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:24.702+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:24.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:24.898+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:25.702 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:25.694+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:25.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:25.886+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:26.753 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:26.746+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:26.914 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:26.906+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:27.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:27.790+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:27.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:27.946+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:28.847 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:28.838+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:28.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:28.990+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:29.857 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:29.850+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:29.976 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:29.970+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:30.858 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:30.850+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:31.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:30.994+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:31.857 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:31.850+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:32.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:32.030+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:32.833 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:32.826+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:33.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:33.022+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:33.800 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:33.790+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:34.075 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:34.066+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:34.801 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:34.794+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:35.064 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:35.058+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:35.828 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:35.822+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:36.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:36.038+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:36.782 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:36.774+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:37.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:37.030+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:37.787 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:37.778+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:38.080 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:38.074+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:38.770 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:38.762+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:39.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:39.110+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:39.780 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:39.774+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:40.077 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:40.070+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:40.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:40.810+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:41.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:41.118+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:41.861 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:41.854+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:42.099 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:42.090+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:42.897 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:42.890+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:43.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:43.062+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:43.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:43.906+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:44.067 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:44.058+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:44.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:44.950+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:45.055 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:45.050+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:45.985 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:45.978+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:46.067 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:46.058+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:46.967 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:46.958+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:47.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:47.058+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:47.933 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:47.926+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:48.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:48.054+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:48.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:48.910+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:49.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:49.050+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:49.941 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:49.934+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:50.086 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:50.078+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:50.924 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:50.918+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:51.082 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:51.074+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:51.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:51.902+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:52.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:52.078+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:52.871 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:52.862+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:53.042 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:53.034+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:53.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:53.910+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:54.011 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:54.002+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:54.960 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:54.954+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:54.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:54.982+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:55.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:55.958+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:55.995 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:55.986+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:56.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:56.954+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:56.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:56.966+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:57.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:57.954+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:57.992 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:57.986+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:58.948 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:58.942+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:39:59.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:39:59.022+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:39:59.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:39:59.922+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:00.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:00.006+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:00.961 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:00.954+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:01.050 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:01.042+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:02.005 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:01.998+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:02.037 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:02.030+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:02.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:02.970+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:03.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:03.014+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:03.988 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:03.982+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:04.011 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:04.002+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:04.950 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:04.942+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:04.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:04.966+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:05.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:05.962+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:05.998 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:05.990+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:06.995 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:06.986+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:07.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:06.994+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:07.951 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:07.942+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:08.050 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:08.042+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:08.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:08.954+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:09.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:09.090+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:10.010 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:10.002+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:10.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:10.138+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:11.047 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:11.038+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:11.148 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:11.138+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:12.047 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:12.038+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:12.124 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:12.118+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:13.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:13.066+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:13.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:13.074+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:14.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:14.070+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:14.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:14.106+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:15.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:15.058+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:15.077 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:15.070+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:16.027 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:16.018+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:16.036 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:16.030+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:17.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:17.006+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:17.049 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:17.042+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:18.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:18.018+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:18.067 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:18.058+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:19.031 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:19.022+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:19.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:19.038+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:20.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:20.010+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:20.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:20.070+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:21.058 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:21.050+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:21.129 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:21.122+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:22.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:22.062+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:22.125 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:22.118+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:23.106 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:23.098+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:23.173 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:23.166+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:24.096 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:24.090+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:24.150 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:24.142+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:25.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:25.078+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:25.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:25.110+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:26.064 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:26.058+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:26.131 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:26.122+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:27.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:27.062+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:27.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:27.170+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:28.041 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:28.034+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:28.223 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:28.214+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:29.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:29.006+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:29.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:29.202+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:29.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:29.982+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:30.205 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:30.198+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:31.011 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:31.002+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:31.193 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:31.186+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:32.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:32.050+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:32.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:32.186+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:33.068 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:33.062+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:33.227 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:33.218+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:34.055 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:34.046+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:34.228 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:34.222+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:35.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:35.014+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:35.219 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:35.210+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:35.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:35.978+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:36.249 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:36.242+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:36.957 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:36.950+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:37.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:37.246+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:37.913 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:37.906+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:38.243 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:38.234+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:38.879 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:38.870+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:39.214 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:39.206+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:39.879 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:39.870+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:40.252 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:40.246+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:40.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:40.838+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:41.273 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:41.266+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:41.889 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:41.882+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:42.313 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:42.306+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:42.845 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:42.838+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:43.308 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:43.298+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:43.881 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:43.874+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:44.339 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:44.330+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:44.864 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:44.858+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:45.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:45.374+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:45.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:45.854+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:46.389 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:46.382+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:46.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:46.890+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:47.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:47.413+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:47.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:47.861+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:48.421 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:48.413+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:48.876 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:48.865+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:49.440 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:49.433+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:49.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:49.837+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:50.410 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:50.401+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:50.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:50.837+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:51.427 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:51.417+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:51.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:51.849+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:52.465 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:52.457+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:52.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:52.865+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:53.430 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:53.421+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:53.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:53.909+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:54.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:54.385+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:54.956 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:54.949+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:55.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:55.341+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:55.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:55.953+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:56.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:56.345+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:56.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:56.953+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:57.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:57.357+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:57.922 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:57.917+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:58.317 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:58.313+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:58.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:58.881+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:40:59.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:40:59.305+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:40:59.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:40:59.837+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:00.308 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:00.305+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:00.812 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:00.805+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:01.344 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:01.341+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:01.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:01.781+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:02.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:02.297+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:02.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:02.821+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:03.261 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:03.257+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:03.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:03.793+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:04.279 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:04.273+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:04.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:04.817+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:05.298 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:05.293+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:05.783 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:05.777+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:06.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:06.277+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:06.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:06.797+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:07.269 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:07.265+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:07.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:07.805+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:08.301 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:08.297+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:08.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:08.793+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:09.302 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:09.297+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:09.789 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:09.785+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:10.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:10.345+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:10.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:10.809+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:11.367 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:11.361+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:11.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:11.777+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:12.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:12.409+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:12.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:12.813+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:13.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:13.437+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:13.821 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:13.817+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:14.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:14.465+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:14.773 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:14.769+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:15.499 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:15.493+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:15.742 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:15.737+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:16.516 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:16.509+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:16.713 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:16.709+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:17.493 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:17.489+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:17.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:17.733+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:18.458 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:18.453+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:18.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:18.741+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:19.474 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:19.469+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:19.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:19.757+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:20.484 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:20.477+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:20.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:20.789+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:21.500 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:21.493+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:21.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:21.817+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:22.498 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:22.493+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:22.814 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:22.809+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:23.488 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:23.485+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:23.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:23.797+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:24.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:24.477+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:24.827 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:24.821+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:25.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:25.429+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:25.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:25.781+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:26.475 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:26.469+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:26.821 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:26.817+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:27.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:27.481+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:27.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:27.865+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:28.453 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:28.449+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:28.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:28.877+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:29.426 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:29.421+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:29.911 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:29.901+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:30.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:30.397+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:30.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:30.925+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:31.394 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:31.389+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:31.975 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:31.969+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:32.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:32.413+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:33.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:33.017+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:33.420 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:33.413+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:33.978 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:33.973+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:34.431 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:34.425+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:34.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:34.965+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:35.442 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:35.437+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:36.017 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:36.013+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:36.484 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:36.477+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:37.035 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:37.029+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:37.508 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:37.505+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:38.053 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:38.049+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:38.528 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:38.521+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:39.007 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:39.001+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:39.532 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:39.525+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:39.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:39.957+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:40.508 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:40.501+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:40.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:40.925+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:41.498 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:41.493+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:41.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:41.913+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:42.510 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:42.505+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:42.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:42.913+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:43.546 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:43.541+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:43.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:43.913+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:44.577 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:44.573+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:44.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:44.929+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:45.617 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:45.613+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:45.978 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:45.973+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:46.600 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:46.593+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:46.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:46.961+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:47.562 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:47.557+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:47.957 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:47.953+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:48.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:48.601+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:48.992 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:48.989+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:49.624 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:49.621+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:50.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:50.009+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:50.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:50.585+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:51.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:51.013+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:51.640 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:51.637+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:52.049 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:52.045+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:52.661 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:52.657+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:53.056 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:53.053+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:53.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:53.701+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:54.050 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:54.045+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:54.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:54.745+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:55.017 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:55.013+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:55.786 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:55.781+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:56.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:56.009+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:56.834 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:56.829+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:57.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:57.009+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:57.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:57.789+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:58.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:57.993+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:58.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:58.797+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:41:59.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:41:59.017+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:41:59.808 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:41:59.801+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:00.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:00.065+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:00.778 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:00.773+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:01.089 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:01.085+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:01.823 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:01.817+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:02.119 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:02.113+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:02.830 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:02.825+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:03.134 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:03.129+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:03.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:03.781+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:04.148 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:04.145+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:04.777 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:04.773+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:05.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:05.121+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:05.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:05.821+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:06.083 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:06.077+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:06.858 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:06.853+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:07.124 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:07.117+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:07.855 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:07.849+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:08.093 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:08.089+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:08.871 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:08.865+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:09.054 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:09.049+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:09.899 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:09.892+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:10.065 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:10.060+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:10.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:10.908+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:11.032 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:11.024+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:11.884 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:11.880+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:11.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:11.984+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:12.837 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:12.832+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:12.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:12.956+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:13.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:13.812+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:13.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:13.964+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:14.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:14.844+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:14.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:14.928+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:15.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:15.844+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:15.973 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:15.968+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:16.890 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:16.884+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:17.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:17.008+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:17.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:17.908+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:18.020 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:18.012+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:18.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:18.904+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:19.027 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:19.020+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:19.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:19.952+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:20.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:20.012+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:20.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:20.920+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:20.983 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:20.976+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:21.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:21.952+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:22.026 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:22.020+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:22.984 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:22.976+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:23.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:23.056+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:23.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:23.992+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:24.065 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:24.060+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:25.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:25.028+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:25.070 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:25.064+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:25.991 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:25.984+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:26.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:26.096+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:26.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:26.964+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:27.055 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:27.048+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:27.993 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:27.988+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:28.028 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:28.020+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:29.015 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:29.008+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:29.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:29.068+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:30.037 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:30.032+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:30.103 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:30.096+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:31.050 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:31.044+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:31.103 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:31.096+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:32.021 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:32.016+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:32.077 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:32.072+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:33.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:33.024+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:33.125 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:33.120+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:34.019 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:34.012+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:34.174 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:34.168+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:35.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:35.040+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:35.136 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:35.128+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:36.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:36.084+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:36.184 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:36.176+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:37.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:37.132+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:37.198 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:37.192+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:38.109 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:38.104+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:38.186 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:38.180+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:39.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:39.112+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:39.164 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:39.156+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:40.094 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:40.088+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:40.203 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:40.196+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:41.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:41.076+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:41.205 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:41.200+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:42.097 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:42.092+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:42.194 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:42.188+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:43.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:43.076+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:43.168 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:43.160+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:44.080 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:44.072+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:44.208 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:44.200+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:45.056 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:45.052+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:45.167 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:45.160+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:46.107 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:46.100+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:46.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:46.200+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:47.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:47.084+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:47.182 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:47.176+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:48.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:48.132+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:48.193 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:48.184+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:49.107 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:49.100+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:49.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:49.160+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:50.115 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:50.108+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:50.181 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:50.176+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:51.139 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:51.132+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:51.183 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:51.176+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:52.131 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:52.124+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:52.193 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:52.188+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:53.139 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:53.132+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:53.209 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:53.204+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:54.129 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:54.124+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:54.176 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:54.168+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:55.109 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:55.104+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:55.198 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:55.192+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:56.102 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:56.096+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:56.231 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:56.224+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:57.123 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:57.116+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:57.219 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:57.212+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:58.076 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:58.068+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:58.200 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:58.196+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:42:59.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:42:59.076+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:42:59.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:42:59.236+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:00.114 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:00.108+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:00.242 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:00.236+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:01.125 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:01.120+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:01.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:01.200+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:02.127 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:02.120+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:02.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:02.216+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:03.114 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:03.108+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:03.266 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:03.260+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:04.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:04.108+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:04.294 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:04.288+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:05.101 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:05.096+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:05.310 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:05.304+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:06.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:06.096+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:06.358 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:06.352+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:07.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:07.088+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:07.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:07.372+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:08.086 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:08.076+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:08.398 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:08.392+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:09.090 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:09.084+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:09.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:09.400+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:10.046 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:10.040+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:10.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:10.428+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:11.074 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:11.068+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:11.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:11.400+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:12.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:12.028+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:12.382 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:12.376+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:13.076 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:13.068+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:13.371 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:13.364+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:14.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:14.024+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:14.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:14.340+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:15.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:15.040+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:15.347 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:15.340+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:16.059 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:16.052+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:16.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:16.360+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:17.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:17.008+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:17.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:17.380+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:17.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:17.964+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:18.347 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:18.340+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:18.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:18.952+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:19.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:19.340+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:20.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:20.000+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:20.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:20.372+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:21.049 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:21.044+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:21.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:21.396+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:22.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:22.028+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:22.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:22.448+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:23.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:23.012+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:23.491 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:23.484+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:23.985 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:23.980+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:24.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:24.468+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:24.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:24.936+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:25.475 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:25.468+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:25.973 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:25.968+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:26.504 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:26.496+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:27.021 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:27.016+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:27.531 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:27.524+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:28.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:28.036+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:28.577 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:28.571+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:29.084 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:29.075+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:29.614 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:29.607+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:30.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:30.127+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:30.610 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:30.603+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:31.118 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:31.111+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:31.593 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:31.587+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:32.077 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:32.071+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:32.552 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:32.543+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:33.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:33.027+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:33.572 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:33.563+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:34.050 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:34.043+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:34.601 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:34.595+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:35.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:35.019+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:35.574 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:35.567+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:36.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:36.063+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:36.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:36.599+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:37.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:37.055+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:37.595 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:37.587+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:38.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:38.035+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:38.613 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:38.607+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:39.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:38.995+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:39.659 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:39.651+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:39.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:39.983+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:40.657 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:40.651+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:40.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:40.939+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:41.624 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:41.615+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:41.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:41.907+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:42.638 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:42.631+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:42.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:42.927+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:43.623 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:43.615+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:43.891 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:43.883+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:44.580 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:44.575+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:44.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:44.895+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:45.594 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:45.587+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:45.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:45.939+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:46.565 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:46.559+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:46.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:46.931+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:47.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:47.531+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:47.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:47.911+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:48.520 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:48.511+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:48.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:48.951+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:49.517 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:49.511+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:50.004 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:49.995+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:50.497 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:50.491+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:51.053 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:51.047+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:51.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:51.531+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:52.087 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:52.079+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:52.491 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:52.483+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:53.100 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:53.091+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:53.521 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:53.515+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:54.125 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:54.119+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:54.558 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:54.551+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:55.171 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:55.163+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:55.531 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:55.523+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:56.193 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:56.187+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:56.486 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:56.479+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:57.165 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:57.159+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:57.471 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:57.463+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:58.124 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:58.115+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:58.477 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:58.471+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:43:59.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:43:59.083+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:43:59.481 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:43:59.475+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:00.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:00.131+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:00.522 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:00.515+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:01.128 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:01.119+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:01.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:01.499+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:02.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:02.155+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:02.505 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:02.499+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:03.191 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:03.183+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:03.484 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:03.475+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:04.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:04.175+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:04.519 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:04.511+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:05.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:05.163+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:05.547 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:05.539+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:06.159 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:06.151+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:06.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:06.535+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:07.197 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:07.191+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:07.499 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:07.491+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:08.173 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:08.167+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:08.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:08.459+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:09.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:09.175+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:09.452 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:09.443+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:10.137 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:10.131+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:10.495 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:10.487+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:11.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:11.111+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:11.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:11.531+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:12.084 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:12.075+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:12.506 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:12.499+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:13.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:13.063+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:13.522 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:13.515+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:14.101 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:14.091+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:14.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:14.519+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:15.099 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:15.091+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:15.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:15.499+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:16.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:16.055+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:16.538 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:16.531+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:17.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:17.035+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:17.502 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:17.495+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:17.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:17.991+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:18.530 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:18.523+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:19.040 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:19.031+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:19.544 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:19.535+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:20.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:20.079+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:20.538 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:20.531+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:21.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:21.087+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:21.508 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:21.499+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:22.146 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:22.139+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:22.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:22.491+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:23.154 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:23.147+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:23.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:23.459+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:24.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:24.135+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:24.486 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:24.479+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:25.150 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:25.143+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:25.494 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:25.487+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:26.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:26.115+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:26.455 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:26.447+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:27.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:27.075+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:27.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:27.431+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:28.113 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:28.107+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:28.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:28.423+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:29.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:29.063+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:29.423 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:29.415+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:30.090 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:30.083+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:30.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:30.383+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:31.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:31.039+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:31.377 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:31.371+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:32.003 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:31.995+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:32.351 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:32.343+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:33.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:33.035+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:33.341 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:33.335+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:34.090 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:34.083+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:34.357 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:34.351+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:35.101 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:35.091+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:35.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:35.399+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:36.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:36.131+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:36.408 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:36.399+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:37.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:37.155+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:37.375 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:37.367+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:38.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:38.195+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:38.380 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:38.371+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:39.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:39.171+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:39.385 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:39.379+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:40.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:40.135+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:40.358 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:40.351+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:41.127 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:41.119+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:41.342 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:41.335+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:42.147 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:42.139+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:42.363 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:42.355+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:43.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:43.103+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:43.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:43.355+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:44.131 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:44.123+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:44.375 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:44.367+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:45.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:45.170+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:45.418 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:45.410+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:46.160 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:46.150+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:46.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:46.430+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:47.197 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:47.190+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:47.467 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:47.458+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:48.245 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:48.238+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:48.490 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:48.482+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:49.284 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:49.274+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:49.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:49.490+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:50.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:50.270+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:50.494 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:50.486+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:51.287 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:51.278+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:51.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:51.466+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:52.280 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:52.270+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:52.445 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:52.434+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:53.239 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:53.230+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:53.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:53.426+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:54.275 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:54.266+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:54.423 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:54.414+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:55.310 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:55.302+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:55.410 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:55.402+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:56.265 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:56.258+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:56.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:56.374+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:57.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:57.270+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:57.357 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:57.350+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:58.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:58.274+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:58.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:58.394+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:44:59.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:44:59.254+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:44:59.414 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:44:59.406+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:00.232 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:00.222+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:00.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:00.394+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:01.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:01.250+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:01.417 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:01.410+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:02.211 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:02.202+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:02.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:02.446+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:03.229 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:03.222+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:03.415 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:03.406+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:04.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:04.250+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:04.383 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:04.374+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:05.297 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:05.290+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:05.341 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:05.334+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:06.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:06.254+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:06.313 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:06.306+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:07.300 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:07.290+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:07.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:07.330+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:08.257 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:08.246+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:08.339 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:08.330+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:09.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:09.298+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:09.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:09.378+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:10.305 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:10.294+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:10.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:10.370+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:11.273 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:11.266+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:11.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:11.350+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:12.251 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:12.242+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:12.317 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:12.306+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:13.213 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:13.206+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:13.284 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:13.274+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:14.232 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:14.222+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:14.313 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:14.306+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:15.187 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:15.178+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:15.266 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:15.258+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:16.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:16.178+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:16.274 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:16.266+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:17.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:17.146+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:17.236 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:17.226+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:18.108 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:18.098+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:18.211 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:18.202+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:19.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:19.122+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:19.174 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:19.166+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:20.111 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:20.102+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:20.171 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:20.162+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:21.119 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:21.110+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:21.157 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:21.150+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:22.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:22.130+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:22.180 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:22.170+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:23.148 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:23.138+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:23.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:23.182+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:24.174 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:24.166+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:24.174 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:24.166+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:25.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:25.162+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:25.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:25.170+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:26.150 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:26.142+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:26.169 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:26.162+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:27.105 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:27.094+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:27.170 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:27.162+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:28.066 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:28.058+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:28.135 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:28.126+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:29.101 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:29.094+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:29.169 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:29.158+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:30.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:30.046+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:30.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:30.170+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:31.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:31.006+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:31.133 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:31.126+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:31.993 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:31.982+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:32.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:32.150+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:32.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:32.946+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:33.193 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:33.186+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:33.983 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:33.974+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:34.185 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:34.178+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:34.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:34.934+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:35.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:35.182+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:35.921 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:35.914+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:36.163 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:36.154+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:36.909 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:36.902+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:37.203 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:37.194+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:37.878 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:37.870+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:38.213 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:38.202+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:38.843 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:38.834+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:39.209 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:39.198+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:39.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:39.790+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:40.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:40.186+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:40.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:40.770+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:41.215 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:41.206+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:41.771 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:41.762+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:42.215 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:42.206+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:42.771 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:42.762+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:43.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:43.226+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:43.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:43.806+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:44.232 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:44.222+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:44.802 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:44.794+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:45.224 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:45.214+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:45.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:45.838+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:46.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:46.186+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:46.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:46.886+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:47.184 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:47.174+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:47.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:47.842+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:48.218 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:48.210+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:48.899 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:48.890+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:49.253 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:49.242+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:49.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:49.846+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:50.239 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:50.230+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:50.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:50.810+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:51.264 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:51.254+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:51.787 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:51.778+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:52.247 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:52.238+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:52.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:52.766+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:53.222 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:53.214+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:53.817 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:53.810+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:54.264 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:54.254+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:54.802 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:54.794+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:55.273 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:55.262+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:55.830 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:55.822+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:56.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:56.290+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:56.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:56.846+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:57.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:57.318+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:57.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:57.838+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:58.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:58.338+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:58.825 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:58.814+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:45:59.385 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:45:59.374+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:45:59.855 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:45:59.846+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:00.390 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:00.382+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:00.867 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:00.857+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:01.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:01.429+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:01.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:01.865+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:02.403 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:02.393+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:02.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:02.905+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:03.427 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:03.417+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:03.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:03.941+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:04.414 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:04.405+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:04.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:04.905+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:05.418 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:05.409+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:05.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:05.901+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:06.443 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:06.433+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:06.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:06.925+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:07.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:07.445+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:07.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:07.949+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:08.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:08.493+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:08.969 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:08.961+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:09.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:09.537+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:09.941 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:09.933+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:10.541 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:10.533+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:10.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:10.961+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:11.590 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:11.585+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:11.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:11.917+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:12.610 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:12.605+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:12.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:12.953+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:13.582 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:13.577+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:13.927 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:13.921+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:14.575 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:14.569+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:14.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:14.913+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:15.596 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:15.589+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:15.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:15.929+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:16.623 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:16.617+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:16.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:16.953+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:17.673 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:17.669+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:17.985 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:17.977+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:18.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:18.709+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:19.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:19.017+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:19.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:19.753+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:19.999 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:19.993+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:20.771 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:20.765+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:21.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:21.001+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:21.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:21.785+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:22.051 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:22.045+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:22.752 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:22.745+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:23.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:23.005+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:23.740 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:23.733+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:23.992 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:23.985+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:24.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:24.693+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:25.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:25.029+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:25.662 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:25.657+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:26.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:26.073+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:26.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:26.649+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:27.105 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:27.097+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:27.650 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:27.645+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:28.115 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:28.109+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:28.640 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:28.633+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:29.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:29.085+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:29.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:29.661+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:30.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:30.049+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:30.713 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:30.705+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:31.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:31.049+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:31.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:31.733+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:32.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:32.049+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:32.702 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:32.697+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:33.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:33.037+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:33.678 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:33.673+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:34.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:34.025+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:34.684 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:34.677+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:35.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:35.013+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:35.664 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:35.657+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:36.061 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:36.053+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:36.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:36.665+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:37.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:37.085+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:37.646 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:37.641+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:38.064 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:38.057+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:38.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:38.677+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:39.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:39.037+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:39.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:39.705+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:40.061 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:40.053+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:40.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:40.665+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:41.065 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:41.057+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:41.643 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:41.637+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:42.027 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:42.021+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:42.631 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:42.625+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:43.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:43.013+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:43.618 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:43.613+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:44.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:44.013+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:44.575 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:44.569+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:45.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:44.997+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:45.571 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:45.565+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:45.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:45.953+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:46.603 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:46.597+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:46.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:46.937+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:47.603 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:47.597+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:47.920 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:47.913+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:48.604 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:48.597+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:48.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:48.961+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:49.627 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:49.621+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:50.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:49.993+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:50.616 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:50.609+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:51.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:51.005+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:51.636 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:51.629+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:51.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:51.965+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:52.676 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:52.669+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:52.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:52.989+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:53.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:53.697+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:54.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:54.001+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:54.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:54.721+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:55.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:55.033+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:55.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:55.709+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:56.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:56.009+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:56.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:56.741+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:56.967 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:56.961+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:57.758 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:57.753+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:57.996 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:57.989+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:58.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:58.757+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:46:58.969 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:46:58.961+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:46:59.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:46:59.773+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:00.012 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:00.005+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:00.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:00.797+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:01.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:01.057+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:01.758 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:01.753+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:02.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:02.033+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:02.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:02.745+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:03.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:03.025+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:03.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:03.781+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:04.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:04.029+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:04.762 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:04.757+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:05.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:05.065+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:05.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:05.749+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:06.040 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:06.033+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:06.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:06.753+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:07.027 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:07.021+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:07.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:07.737+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:08.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:08.033+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:08.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:08.713+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:09.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:09.017+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:09.684 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:09.677+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:09.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:09.977+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:10.682 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:10.677+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:10.992 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:10.985+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:11.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:11.669+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:12.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:12.021+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:12.692 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:12.685+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:13.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:13.049+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:13.692 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:13.685+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:14.097 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:14.089+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:14.708 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:14.701+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:15.136 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:15.128+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:15.728 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:15.720+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:16.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:16.172+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:16.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:16.768+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:17.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:17.156+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:17.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:17.772+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:18.137 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:18.128+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:18.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:18.760+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:19.147 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:19.140+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:19.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:19.736+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:20.197 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:20.188+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:20.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:20.776+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:21.176 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:21.168+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:21.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:21.772+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:22.137 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:22.128+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:22.788 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:22.780+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:23.109 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:23.100+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:23.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:23.816+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:24.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:24.112+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:24.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:24.848+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:25.108 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:25.100+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:25.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:25.832+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:26.128 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:26.120+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:26.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:26.864+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:27.100 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:27.092+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:27.887 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:27.880+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:28.125 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:28.116+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:28.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:28.852+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:29.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:29.124+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:29.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:29.852+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:30.124 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:30.116+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:30.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:30.900+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:31.105 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:31.096+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:31.933 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:31.924+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:32.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:32.052+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:32.923 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:32.916+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:33.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:33.068+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:33.960 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:33.952+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:34.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:34.096+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:34.965 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:34.956+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:35.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:35.112+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:35.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:35.980+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:36.160 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:36.152+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:36.965 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:36.956+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:37.187 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:37.180+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:37.943 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:37.936+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:38.229 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:38.220+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:38.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:38.960+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:39.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:39.176+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:39.944 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:39.936+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:40.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:40.132+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:40.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:40.912+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:41.131 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:41.124+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:41.936 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:41.928+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:42.129 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:42.120+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:42.985 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:42.976+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:43.159 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:43.152+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:43.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:43.972+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:44.146 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:44.140+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:44.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:44.984+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:45.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:45.136+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:45.944 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:45.936+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:46.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:46.188+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:46.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:46.944+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:47.161 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:47.152+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:47.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:47.908+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:48.156 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:48.148+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:48.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:48.920+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:49.125 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:49.116+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:49.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:49.920+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:50.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:50.152+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:50.882 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:50.876+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:51.196 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:51.188+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:51.891 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:51.884+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:52.167 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:52.160+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:52.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:52.836+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:53.163 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:53.156+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:53.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:53.848+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:54.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:54.176+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:54.887 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:54.880+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:55.160 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:55.152+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:55.929 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:55.920+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:56.149 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:56.140+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:56.912 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:56.900+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:57.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:57.172+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:57.926 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:57.920+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:58.159 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:58.152+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:58.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:58.892+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:47:59.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:47:59.204+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:47:59.862 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:47:59.852+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:00.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:00.204+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:00.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:00.904+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:01.219 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:01.212+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:01.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:01.944+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:02.269 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:02.260+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:02.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:02.980+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:03.238 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:03.232+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:03.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:03.980+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:04.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:04.188+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:04.948 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:04.940+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:05.187 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:05.180+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:05.906 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:05.896+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:06.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:06.148+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:06.886 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:06.880+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:07.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:07.180+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:07.903 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:07.896+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:08.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:08.136+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:08.879 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:08.872+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:09.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:09.120+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:09.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:09.912+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:10.165 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:10.156+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:10.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:10.960+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:11.159 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:11.152+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:11.958 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:11.952+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:12.201 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:12.192+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:12.956 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:12.948+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:13.251 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:13.244+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:13.966 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:13.960+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:14.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:14.236+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:14.951 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:14.944+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:15.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:15.204+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:15.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:15.972+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:16.257 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:16.248+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:16.941 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:16.932+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:17.292 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:17.284+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:17.925 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:17.916+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:18.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:18.324+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:18.969 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:18.960+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:19.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:19.368+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:19.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:19.952+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:20.420 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:20.412+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:20.966 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:20.960+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:21.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:21.416+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:21.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:21.964+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:22.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:22.388+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:23.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:22.996+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:23.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:23.432+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:23.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:23.964+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:24.407 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:24.400+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:24.938 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:24.932+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:25.428 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:25.420+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:25.960 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:25.952+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:26.433 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:26.424+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:26.973 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:26.964+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:27.464 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:27.456+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:27.926 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:27.920+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:28.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:28.472+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:28.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:28.923+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:29.485 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:29.475+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:29.969 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:29.959+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:30.460 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:30.451+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:30.975 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:30.967+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:31.448 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:31.439+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:31.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:31.967+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:32.409 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:32.399+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:32.993 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:32.983+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:33.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:33.427+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:33.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:33.979+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:34.429 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:34.419+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:35.019 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:35.011+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:35.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:35.391+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:36.042 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:36.031+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:36.415 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:36.407+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:37.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:37.015+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:37.431 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:37.423+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:38.048 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:38.039+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:38.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:38.463+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:39.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:38.995+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:39.456 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:39.447+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:40.047 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:40.039+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:40.496 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:40.487+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:41.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:41.055+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:41.545 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:41.535+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:42.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:42.015+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:42.593 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:42.583+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:42.998 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:42.991+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:43.602 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:43.595+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:43.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:43.979+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:44.631 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:44.623+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:44.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:44.979+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:45.664 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:45.655+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:45.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:45.951+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:46.642 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:46.631+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:46.922 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:46.911+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:47.664 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:47.655+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:47.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:47.947+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:48.655 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:48.647+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:48.965 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:48.955+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:49.644 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:49.635+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:49.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:49.979+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:50.624 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:50.615+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:51.009 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:50.999+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:51.665 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:51.655+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:52.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:52.007+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:52.681 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:52.671+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:53.065 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:53.055+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:53.646 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:53.639+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:54.098 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:54.087+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:54.627 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:54.619+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:55.116 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:55.107+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:55.676 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:55.667+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:56.108 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:56.099+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:56.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:56.699+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:57.144 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:57.135+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:57.699 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:57.691+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:58.190 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:58.183+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:58.718 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:58.711+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:48:59.226 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:48:59.219+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:48:59.714 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:48:59.707+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:00.277 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:00.267+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:00.694 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:00.687+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:00.906 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T01:49:00.899+0000 7f19ac96b700 0 -- 172.21.15.12:0/2562084688 >> [v2:172.21.15.12:6800/29704,v1:172.21.15.12:6801/29704] conn(0x55b0d5339730 msgr2=0x7f198c03adc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2023-08-23T01:49:01.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:01.319+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:01.743 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:01.735+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:02.307 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:02.299+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:02.708 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:02.699+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:03.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:03.327+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:03.668 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:03.659+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:04.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:04.355+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:04.714 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:04.703+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:05.355 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:05.347+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:05.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:05.739+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:06.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:06.383+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:06.752 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:06.743+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:07.409 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:07.399+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:07.800 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:07.791+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:08.385 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:08.375+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:08.795 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:08.787+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:09.388 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:09.379+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:09.795 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:09.787+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:10.397 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:10.387+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:10.791 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:10.783+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:11.376 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:11.367+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:11.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:11.795+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:12.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:12.359+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:12.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:12.843+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:13.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:13.371+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:13.873 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:13.863+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:14.400 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:14.391+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:14.882 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:14.871+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:15.447 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:15.439+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:15.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:15.843+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:16.409 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:16.399+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:16.829 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:16.819+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:17.459 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:17.451+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:17.790 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:17.779+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:18.447 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:18.439+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:18.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:18.731+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:19.444 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:19.435+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:19.788 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:19.779+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:20.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:20.431+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:20.802 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:20.795+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:21.433 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:21.423+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:21.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:21.815+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:22.418 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:22.407+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:22.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:22.847+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:23.418 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:23.411+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:23.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:23.867+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:24.396 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:24.387+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:24.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:24.839+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:25.372 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:25.363+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:25.891 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:25.883+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:26.335 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:26.327+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:26.870 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:26.863+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:27.304 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:27.295+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:27.888 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:27.879+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:28.352 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:28.343+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:28.865 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:28.855+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:29.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:29.339+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:29.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:29.843+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:30.377 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:30.367+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:30.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:30.887+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:31.333 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:31.323+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:31.870 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:31.859+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:32.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:32.339+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:32.912 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:32.903+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:33.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:33.319+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:33.909 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:33.899+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:34.348 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:34.339+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:34.909 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:34.899+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:35.374 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:35.367+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:35.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:35.899+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:36.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:36.403+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:36.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:36.907+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:37.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:37.403+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:37.928 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:37.919+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:38.374 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:38.363+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:38.881 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:38.871+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:39.422 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:39.411+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:39.868 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:39.859+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:40.386 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:40.375+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:40.905 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:40.895+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:41.389 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:41.379+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:41.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:41.939+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:42.365 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:42.355+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:42.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:42.971+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:43.399 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:43.391+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:44.005 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:43.995+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:44.406 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:44.399+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:44.983 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:44.975+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:45.410 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:45.399+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:45.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:45.951+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:46.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:46.383+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:46.936 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:46.927+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:47.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:47.427+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:47.899 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:47.891+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:48.414 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:48.403+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:48.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:48.935+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:49.372 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:49.363+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:49.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:49.931+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:50.383 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:50.375+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:50.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:50.907+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:51.417 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:51.407+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:51.873 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:51.863+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:52.462 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:52.455+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:52.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:52.839+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:53.448 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:53.439+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:53.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:53.847+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:54.469 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:54.459+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:54.812 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:54.803+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:55.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:55.447+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:55.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:55.807+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:56.477 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:56.467+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:56.823 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:56.815+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:57.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:57.515+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:57.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:57.831+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:58.551 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:58.543+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:58.795 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:58.787+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:49:59.554 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:49:59.547+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:49:59.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:49:59.739+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:00.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:00.531+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:00.747 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:00.739+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:01.573 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:01.563+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:01.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:01.739+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:02.573 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:02.563+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:02.757 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:02.747+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:03.620 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:03.611+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:03.719 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:03.711+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:04.603 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:04.594+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:04.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:04.730+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:05.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:05.546+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:05.734 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:05.726+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:06.536 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:06.526+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:06.720 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:06.710+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:07.551 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:07.542+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:07.704 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:07.694+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:08.547 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:08.538+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:08.691 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:08.682+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:09.534 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:09.522+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:09.708 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:09.698+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:10.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:10.490+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:10.745 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:10.734+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:11.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:11.498+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:11.769 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:11.758+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:12.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:12.530+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:12.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:12.794+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:13.593 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:13.582+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:13.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:13.842+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:14.598 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:14.590+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:14.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:14.886+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:15.574 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:15.566+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:15.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:15.842+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:16.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:16.550+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:16.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:16.838+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:17.610 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:17.602+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:17.828 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:17.818+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:18.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:18.638+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:18.804 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:18.794+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:19.603 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:19.594+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:19.808 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:19.798+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:20.583 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:20.574+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:20.804 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:20.794+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:21.567 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:21.558+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:21.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:21.814+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:22.553 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:22.542+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:22.797 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:22.786+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:23.589 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:23.578+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:23.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:23.774+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:24.633 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:24.622+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:24.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:24.814+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:25.590 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:25.582+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:25.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:25.866+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:26.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:26.546+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:26.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:26.882+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:27.547 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:27.538+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:27.899 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:27.890+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:28.555 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:28.546+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:28.896 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:28.886+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:29.546 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:29.538+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:29.863 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:29.854+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:30.567 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:30.558+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:30.887 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:30.878+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:31.614 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:31.602+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:31.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:31.866+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:32.650 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:32.638+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:32.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:32.914+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:33.627 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:33.618+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:33.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:33.898+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:34.646 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:34.638+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:34.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:34.910+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:35.694 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:35.686+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:35.891 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:35.882+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:36.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:36.714+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:36.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:36.842+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:37.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:37.706+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:37.855 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:37.846+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:38.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:38.734+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:38.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:38.874+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:39.712 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:39.702+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:39.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:39.874+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:40.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:40.666+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:40.863 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:40.854+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:41.721 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:41.710+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:41.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:41.866+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:42.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:42.746+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:42.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:42.914+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:43.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:43.706+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:43.918 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:43.906+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:44.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:44.662+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:44.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:44.922+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:45.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:45.658+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:45.935 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:45.926+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:46.620 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:46.610+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:46.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:46.946+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:47.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:47.646+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:47.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:47.946+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:48.623 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:48.614+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:49.003 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:48.994+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:49.600 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:49.590+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:50.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:50.022+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:50.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:50.622+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:51.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:50.990+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:51.673 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:51.662+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:52.029 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:52.018+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:52.629 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:52.618+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:52.986 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:52.978+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:53.612 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:53.602+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:53.950 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:53.938+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:54.645 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:54.634+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:54.907 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:54.898+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:55.641 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:55.630+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:55.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:55.898+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:56.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:56.674+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:56.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:56.918+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:57.682 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:57.670+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:57.901 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:57.890+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:58.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:58.694+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:58.867 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:58.858+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:50:59.678 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:50:59.670+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:50:59.867 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:50:59.858+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:00.686 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:00.678+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:00.833 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:00.822+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:01.657 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:01.646+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:01.825 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:01.814+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:02.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:02.622+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:02.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:02.814+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:03.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:03.622+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:03.795 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:03.786+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:04.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:04.622+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:04.773 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:04.762+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:05.660 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:05.650+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:05.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:05.726+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:06.623 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:06.614+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:06.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:06.730+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:07.673 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:07.662+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:07.748 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:07.738+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:08.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:08.714+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:08.743 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:08.734+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:09.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:09.746+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:09.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:09.770+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:10.721 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:10.710+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:10.821 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:10.810+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:11.706 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:11.694+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:11.832 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:11.822+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:12.696 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:12.686+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:12.874 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:12.862+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:13.671 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:13.662+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:13.866 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:13.858+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:14.648 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:14.638+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:14.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:14.898+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:15.614 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:15.606+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:15.882 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:15.874+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:16.604 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:16.594+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:16.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:16.902+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:17.635 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:17.626+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:17.887 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:17.878+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:18.594 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:18.586+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:18.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:18.906+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:19.590 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:19.578+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:19.889 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:19.878+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:20.609 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:20.598+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:20.878 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:20.866+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:21.659 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:21.650+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:21.842 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:21.830+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:22.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:22.686+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:22.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:22.814+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:23.661 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:23.650+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:23.833 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:23.822+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:24.638 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:24.626+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:24.874 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:24.862+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:25.599 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:25.590+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:25.832 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:25.822+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:26.574 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:26.562+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:26.814 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:26.806+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:27.617 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:27.606+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:27.767 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:27.758+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:28.611 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:28.602+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:28.770 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:28.762+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:29.599 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:29.590+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:29.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:29.790+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:30.553 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:30.542+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:30.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:30.770+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:31.534 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:31.522+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:31.798 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:31.790+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:32.525 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:32.514+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:32.767 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:32.758+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:33.540 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:33.530+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:33.788 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:33.778+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:34.549 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:34.538+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:34.781 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:34.770+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:35.592 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:35.582+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:35.775 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:35.766+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:36.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:36.550+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:36.751 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:36.742+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:37.545 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:37.534+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:37.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:37.762+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:38.512 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:38.502+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:38.787 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:38.778+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:39.485 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:39.474+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:39.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:39.802+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:40.518 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:40.506+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:40.842 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:40.830+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:41.536 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:41.526+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:41.846 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:41.834+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:42.516 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:42.506+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:42.891 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:42.882+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:43.472 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:43.462+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:43.896 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:43.886+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:44.520 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:44.510+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:44.860 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:44.850+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:45.495 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:45.486+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:45.870 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:45.858+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:46.484 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:46.473+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:46.846 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:46.833+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:47.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:47.517+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:47.887 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:47.877+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:48.501 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:48.489+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:48.905 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:48.893+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:49.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:49.497+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:49.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:49.897+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:50.498 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:50.485+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:50.897 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:50.885+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:51.470 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:51.457+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:51.921 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:51.909+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:52.423 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:52.413+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:52.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:52.953+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:53.377 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:53.365+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:53.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:53.913+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:54.419 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:54.409+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:54.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:54.937+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:55.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:55.445+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:55.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:55.937+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:56.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:56.457+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:56.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:56.937+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:57.459 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:57.449+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:57.935 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:57.925+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:58.478 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:58.465+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:58.892 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:58.881+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:51:59.521 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:51:59.513+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:51:59.885 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:51:59.877+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:00.481 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:00.473+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:00.880 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:00.873+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:01.459 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:01.453+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:01.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:01.921+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:02.455 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:02.449+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:02.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:02.905+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:03.502 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:03.493+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:03.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:03.933+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:04.519 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:04.513+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:04.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:04.969+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:05.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:05.533+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:05.969 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:05.961+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:06.531 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:06.525+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:07.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:07.009+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:07.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:07.549+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:08.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:08.033+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:08.580 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:08.573+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:09.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:09.049+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:09.625 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:09.617+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:10.021 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:10.013+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:10.655 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:10.649+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:11.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:11.005+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:11.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:11.641+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:11.981 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:11.973+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:12.698 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:12.689+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:12.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:12.933+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:13.691 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:13.685+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:13.969 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:13.961+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:14.678 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:14.669+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:14.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:14.989+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:15.640 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:15.633+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:16.004 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:15.997+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:16.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:16.665+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:17.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:17.025+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:17.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:17.661+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:18.021 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:18.013+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:18.651 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:18.645+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:19.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:19.033+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:19.637 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:19.629+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:20.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:19.993+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:20.643 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:20.637+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:21.044 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:21.037+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:21.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:21.625+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:21.998 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:21.989+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:22.650 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:22.641+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:22.991 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:22.985+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:23.606 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:23.601+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:24.014 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:24.009+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:24.655 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:24.649+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:25.065 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:25.057+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:25.636 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:25.629+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:26.110 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:26.101+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:26.668 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:26.661+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:27.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:27.133+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:27.624 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:27.617+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:28.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:28.181+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:28.590 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:28.585+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:29.157 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:29.149+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:29.607 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:29.601+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:30.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:30.185+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:30.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:30.569+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:31.196 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:31.189+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:31.553 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:31.545+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:32.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:32.161+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:32.591 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:32.585+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:33.214 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:33.209+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:33.603 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:33.597+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:34.249 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:34.241+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:34.622 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:34.613+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:35.207 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:35.201+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:35.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:35.661+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:36.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:36.229+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:36.627 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:36.621+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:37.199 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:37.193+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:37.637 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:37.629+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:38.247 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:38.241+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:38.600 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:38.593+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:39.200 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:39.193+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:39.608 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:39.601+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:40.238 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:40.233+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:40.630 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:40.621+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:41.269 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:41.261+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:41.639 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:41.633+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:42.263 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:42.257+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:42.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:42.669+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:43.225 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:43.217+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:43.688 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:43.681+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:44.190 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:44.185+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:44.676 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:44.669+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:45.240 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:45.233+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:45.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:45.669+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:46.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:46.229+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:46.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:46.661+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:47.287 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:47.281+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:47.662 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:47.653+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:48.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:48.301+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:48.680 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:48.673+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:49.359 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:49.353+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:49.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:49.705+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:50.362 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:50.357+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:50.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:50.697+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:51.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:51.405+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:51.736 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:51.729+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:52.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:52.453+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:52.692 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:52.685+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:53.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:53.409+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:53.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:53.729+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:54.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:54.401+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:54.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:54.709+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:55.431 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:55.425+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:55.732 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:55.725+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:56.434 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:56.429+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:56.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:56.729+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:57.412 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:57.405+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:57.702 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:57.697+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:58.450 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:58.441+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:58.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:58.693+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:52:59.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:52:59.473+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:52:59.663 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:52:59.657+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:00.493 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:00.485+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:00.635 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:00.629+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:01.449 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:01.441+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:01.591 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:01.585+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:02.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:02.477+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:02.573 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:02.565+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:03.477 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:03.469+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:03.550 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:03.541+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:04.499 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:04.493+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:04.545 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:04.537+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:05.525 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:05.517+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:05.565 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:05.557+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:06.525 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:06.517+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:06.532 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:06.525+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:07.515 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:07.509+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:07.517 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:07.509+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:08.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:08.465+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:08.557 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:08.549+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:09.426 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:09.417+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:09.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:09.553+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:10.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:10.385+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:10.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:10.553+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:11.381 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:11.373+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:11.611 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:11.605+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:12.335 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:12.329+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:12.615 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:12.605+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:13.297 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:13.285+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:13.578 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:13.569+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:14.257 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:14.249+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:14.611 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:14.605+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:15.269 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:15.261+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:15.629 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:15.621+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:16.248 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:16.241+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:16.620 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:16.613+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:17.215 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:17.209+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:17.614 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:17.609+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:18.238 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:18.229+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:18.604 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:18.597+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:19.217 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:19.209+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:19.570 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:19.565+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:20.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:20.169+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:20.590 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:20.581+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:21.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:21.129+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:21.619 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:21.613+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:22.099 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:22.089+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:22.636 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:22.629+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:23.051 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:23.045+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:23.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:23.673+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:24.065 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:24.057+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:24.709 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:24.701+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:25.084 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:25.077+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:25.664 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:25.657+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:26.060 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:26.053+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:26.658 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:26.649+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:27.019 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:27.013+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:27.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:27.664+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:28.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:28.064+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:28.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:28.692+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:29.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:29.016+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:29.661 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:29.652+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:30.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:30.052+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:30.640 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:30.632+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:31.064 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:31.056+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:31.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:31.668+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:32.100 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:32.092+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:32.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:32.708+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:33.076 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:33.068+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:33.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:33.728+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:34.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:34.108+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:34.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:34.708+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:35.129 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:35.120+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:35.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:35.716+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:36.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:36.132+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:36.767 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:36.760+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:37.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:37.132+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:37.799 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:37.792+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:38.113 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:38.104+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:38.838 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:38.828+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:39.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:39.104+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:39.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:39.840+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:40.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:40.108+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:40.866 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:40.856+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:41.080 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:41.072+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:41.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:41.900+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:42.051 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:42.044+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:42.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:42.884+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:43.099 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:43.092+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:43.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:43.888+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:44.119 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:44.112+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:44.938 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:44.932+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:45.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:45.068+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:45.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:45.928+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:46.078 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:46.068+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:46.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:46.888+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:47.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:47.044+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:47.937 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:47.928+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:48.015 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:48.008+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:48.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:48.940+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:49.039 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:49.032+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:49.912 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:49.904+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:50.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:50.068+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:50.939 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:50.932+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:51.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:51.036+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:51.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:51.884+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:52.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:52.084+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:52.914 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:52.904+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:53.118 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:53.112+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:53.922 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:53.912+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:54.084 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:54.076+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:54.913 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:54.904+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:55.039 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:55.032+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:55.875 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:55.868+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:56.076 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:56.068+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:56.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:56.840+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:57.127 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:57.120+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:57.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:57.876+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:58.167 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:58.160+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:58.920 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:58.912+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:53:59.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:53:59.168+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:53:59.879 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:53:59.872+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:00.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:00.168+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:00.913 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:00.904+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:01.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:01.128+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:01.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:01.908+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:02.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:02.160+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:02.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:02.908+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:03.163 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:03.152+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:03.911 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:03.904+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:04.156 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:04.148+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:04.943 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:04.936+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:05.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:05.188+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:05.985 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:05.976+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:06.159 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:06.152+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:07.034 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:07.028+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:07.128 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:07.120+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:08.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:07.996+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:08.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:08.128+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:09.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:09.004+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:09.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:09.180+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:10.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:09.996+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:10.149 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:10.140+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:11.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:10.996+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:11.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:11.112+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:12.051 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:12.044+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:12.080 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:12.072+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:13.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:13.008+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:13.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:13.060+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:13.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:13.980+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:14.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:14.020+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:14.987 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:14.980+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:15.019 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:15.012+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:15.998 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:15.988+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:16.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:15.992+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:16.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:16.968+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:17.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:16.992+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:17.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:17.992+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:18.048 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:18.040+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:19.009 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:19.000+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:19.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:19.088+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:19.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:19.984+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:20.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:20.068+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:21.033 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:21.024+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:21.082 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:21.076+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:21.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:21.988+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:22.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:22.064+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:22.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:22.968+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:23.100 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:23.092+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:23.957 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:23.948+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:24.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:24.116+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:24.995 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:24.988+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:25.172 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:25.164+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:25.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:25.968+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:26.214 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:26.204+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:26.952 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:26.944+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:27.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:27.176+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:27.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:27.936+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:28.199 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:28.192+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:28.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:28.924+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:29.213 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:29.204+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:29.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:29.924+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:30.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:30.176+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:30.895 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:30.888+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:31.214 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:31.204+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:31.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:31.852+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:32.199 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:32.192+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:32.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:32.900+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:33.241 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:33.232+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:33.899 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:33.892+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:34.247 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:34.240+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:34.921 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:34.912+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:35.269 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:35.260+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:35.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:35.920+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:36.226 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:36.220+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:36.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:36.944+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:37.246 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:37.236+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:38.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:37.996+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:38.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:38.256+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:39.052 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:39.044+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:39.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:39.252+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:40.103 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:40.096+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:40.260 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:40.252+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:41.089 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:41.080+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:41.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:41.300+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:42.053 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:42.044+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:42.330 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:42.320+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:43.023 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:43.016+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:43.321 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:43.312+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:44.042 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:44.032+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:44.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:44.348+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:45.034 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:45.024+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:45.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:45.368+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:46.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:46.064+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:46.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:46.388+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:47.051 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:47.044+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:47.433 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:47.424+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:48.005 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:47.996+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:48.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:48.424+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:49.011 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:49.004+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:49.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:49.464+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:50.052 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:50.044+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:50.426 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:50.416+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:51.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:51.020+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:51.391 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:51.384+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:52.078 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:52.068+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:52.344 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:52.336+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:53.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:53.076+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:53.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:53.288+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:54.134 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:54.128+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:54.326 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:54.316+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:55.184 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:55.176+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:55.332 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:55.324+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:56.231 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:56.224+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:56.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:56.368+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:57.279 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:57.272+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:57.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:57.380+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:58.246 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:58.236+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:58.396 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:58.388+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:54:59.203 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:54:59.196+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:54:59.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:54:59.396+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:00.158 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:00.148+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:00.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:00.364+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:01.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:01.120+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:01.396 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:01.388+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:02.142 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:02.132+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:02.352 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:02.344+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:03.135 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:03.128+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:03.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:03.368+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:04.165 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:04.156+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:04.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:04.324+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:05.122 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:05.112+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:05.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:05.352+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:06.086 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:06.076+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:06.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:06.308+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:07.098 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:07.088+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:07.299 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:07.292+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:08.128 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:08.116+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:08.280 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:08.272+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:09.116 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:09.108+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:09.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:09.252+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:10.126 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:10.116+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:10.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:10.288+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:11.103 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:11.092+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:11.257 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:11.248+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:12.081 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:12.072+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:12.222 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:12.212+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:13.051 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:13.044+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:13.231 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:13.224+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:14.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:14.012+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:14.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:14.228+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:15.062 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:15.052+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:15.252 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:15.244+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:16.103 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:16.096+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:16.219 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:16.212+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:17.096 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:17.088+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:17.234 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:17.224+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:18.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:18.064+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:18.261 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:18.252+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:19.036 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:19.028+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:19.286 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:19.276+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:20.027 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:20.020+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:20.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:20.236+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:20.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:20.992+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:21.287 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:21.280+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:22.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:22.024+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:22.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:22.272+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:23.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:23.035+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:23.324 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:23.315+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:23.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:23.987+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:24.297 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:24.287+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:25.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:24.991+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:25.342 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:25.331+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:25.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:25.979+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:26.310 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:26.303+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:26.993 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:26.983+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:27.349 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:27.339+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:27.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:27.951+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:28.340 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:28.331+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:28.993 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:28.983+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:29.342 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:29.331+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:30.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:30.007+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:30.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:30.355+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:31.058 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:31.047+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:31.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:31.319+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:32.068 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:32.059+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:32.373 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:32.363+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:33.096 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:33.087+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:33.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:33.347+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:34.141 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:34.131+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:34.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:34.387+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:35.126 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:35.115+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:35.399 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:35.391+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:36.079 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:36.071+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:36.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:36.387+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:37.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:37.063+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:37.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:37.367+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:38.050 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:38.039+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:38.427 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:38.419+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:39.077 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:39.067+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:39.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:39.407+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:40.095 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:40.087+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:40.439 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:40.431+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:41.065 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:41.055+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:41.405 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:41.395+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:42.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:42.055+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:42.415 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:42.407+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:43.041 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:43.031+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:43.411 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:43.403+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:44.059 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:44.051+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:44.416 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:44.407+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:45.056 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:45.047+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:45.463 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:45.455+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:46.079 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:46.071+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:46.448 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:46.439+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:47.041 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:47.031+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:47.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:47.403+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:48.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:47.991+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:48.373 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:48.363+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:49.035 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:49.027+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:49.325 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:49.315+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:50.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:50.035+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:50.349 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:50.339+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:51.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:50.991+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:51.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:51.307+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:52.046 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:52.035+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:52.326 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:52.315+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:53.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:53.019+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:53.290 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:53.279+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:54.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:54.051+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:54.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:54.231+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:55.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:55.003+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:55.223 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:55.215+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:55.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:55.987+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:56.246 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:56.235+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:56.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:56.967+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:57.222 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:57.215+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:58.025 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:58.015+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:58.263 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:58.255+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:59.009 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:58.999+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:55:59.250 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:55:59.239+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:55:59.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:55:59.987+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:00.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:00.267+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:01.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:00.991+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:01.307 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:01.299+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:02.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:02.019+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:02.325 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:02.315+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:03.082 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:03.071+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:03.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:03.339+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:04.065 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:04.055+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:04.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:04.323+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:05.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:05.019+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:05.337 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:05.327+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:06.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:06.063+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:06.361 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:06.351+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:07.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:07.031+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:07.349 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:07.339+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:08.010 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:07.999+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:08.310 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:08.303+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:09.028 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:09.019+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:09.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:09.347+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:10.051 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:10.043+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:10.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:10.343+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:11.065 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:11.055+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:11.340 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:11.331+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:12.027 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:12.019+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:12.358 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:12.347+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:12.981 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:12.971+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:13.320 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:13.311+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:13.936 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:13.927+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:14.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:14.307+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:14.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:14.947+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:15.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:15.295+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:15.941 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:15.931+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:16.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:16.343+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:16.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:16.983+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:17.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:17.315+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:17.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:17.955+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:18.311 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:18.303+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:19.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:18.995+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:19.317 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:19.307+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:20.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:19.995+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:20.326 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:20.315+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:21.008 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:20.999+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:21.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:21.343+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:21.965 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:21.955+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:22.320 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:22.311+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:22.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:22.943+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:23.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:23.327+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:23.909 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:23.899+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:24.324 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:24.315+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:24.897 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:24.887+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:25.314 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:25.303+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:25.937 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:25.927+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:26.328 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:26.319+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:26.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:26.911+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:27.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:27.299+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:27.949 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:27.939+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:28.265 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:28.255+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:29.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:28.991+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:29.310 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:29.299+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:30.041 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:30.031+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:30.263 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:30.255+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:31.007 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:30.999+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:31.229 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:31.219+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:32.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:31.991+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:32.204 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:32.195+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:32.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:32.943+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:33.166 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:33.155+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:33.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:33.907+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:34.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:34.191+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:34.873 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:34.863+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:35.156 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:35.147+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:35.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:35.875+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:36.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:36.151+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:36.836 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:36.827+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:37.114 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:37.103+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:37.880 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:37.871+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:38.107 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:38.099+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:38.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:38.919+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:39.118 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:39.107+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:39.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:39.907+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:40.159 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:40.151+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:40.920 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:40.911+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:41.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:41.171+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:41.921 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:41.911+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:42.157 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:42.147+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:42.902 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:42.895+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:43.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:43.171+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:43.905 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:43.895+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:44.169 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:44.159+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:44.880 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:44.871+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:45.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:45.175+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:45.854 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:45.847+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:46.221 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:46.211+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:46.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:46.811+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:47.263 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:47.255+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:47.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:47.811+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:48.278 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:48.267+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:48.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:48.795+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:49.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:49.227+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:49.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:49.835+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:50.207 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:50.199+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:50.827 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:50.819+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:51.232 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:51.223+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:51.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:51.795+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:52.263 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:52.255+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:52.836 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:52.827+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:53.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:53.299+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:53.886 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:53.875+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:54.345 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:54.335+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:54.874 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:54.867+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:55.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:55.327+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:55.833 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:55.823+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:56.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:56.363+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:56.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:56.779+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:57.394 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:57.383+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:57.752 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:57.743+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:58.355 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:58.347+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:58.764 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:58.755+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:56:59.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:56:59.363+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:56:59.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:56:59.707+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:00.386 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:00.379+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:00.749 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:00.739+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:01.345 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:01.335+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:01.706 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:01.695+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:02.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:02.375+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:02.702 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:02.695+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:03.429 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:03.419+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:03.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:03.727+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:04.411 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:04.403+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:04.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:04.695+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:05.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:05.423+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:05.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:05.739+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:06.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:06.463+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:06.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:06.691+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:07.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:07.459+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:07.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:07.667+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:08.485 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:08.475+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:08.648 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:08.639+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:09.447 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:09.439+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:09.620 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:09.611+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:10.467 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:10.459+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:10.598 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:10.587+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:11.492 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:11.483+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:11.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:11.619+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:12.510 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:12.499+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:12.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:12.659+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:13.476 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:13.467+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:13.640 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:13.631+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:14.447 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:14.439+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:14.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:14.667+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:15.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:15.391+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:15.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:15.703+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:16.450 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:16.439+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:16.685 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:16.675+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:17.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:17.459+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:17.671 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:17.663+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:18.446 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:18.439+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:18.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:18.691+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:19.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:19.403+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:19.725 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:19.715+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:20.444 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:20.435+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:20.724 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:20.715+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:21.430 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:21.419+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:21.775 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:21.767+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:22.468 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:22.459+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:22.783 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:22.775+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:23.445 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:23.435+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:23.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:23.775+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:24.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:24.451+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:24.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:24.807+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:25.479 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:25.471+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:25.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:25.815+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:26.460 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:26.451+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:26.814 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:26.807+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:27.448 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:27.439+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:27.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:27.847+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:28.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:28.391+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:28.836 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:28.827+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:29.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:29.391+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:29.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:29.827+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:30.402 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:30.391+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:30.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:30.863+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:31.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:31.427+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:31.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:31.867+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:32.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:32.387+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:32.836 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:32.827+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:33.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:33.387+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:33.867 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:33.859+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:34.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:34.375+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:34.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:34.835+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:35.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:35.367+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:35.854 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:35.843+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:36.398 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:36.391+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:36.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:36.815+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:37.378 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:37.371+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:37.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:37.783+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:38.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:38.327+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:38.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:38.787+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:39.310 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:39.298+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:39.777 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:39.766+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:40.284 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:40.274+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:40.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:40.730+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:41.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:41.234+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:41.698 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:41.686+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:42.214 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:42.206+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:42.749 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:42.738+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:43.227 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:43.218+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:43.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:43.694+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:44.225 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:44.214+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:44.668 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:44.658+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:45.231 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:45.222+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:45.641 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:45.630+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:46.252 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:46.242+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:46.661 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:46.650+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:47.267 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:47.258+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:47.659 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:47.650+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:48.257 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:48.246+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:48.639 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:48.630+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:49.298 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:49.286+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:49.688 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:49.678+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:50.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:50.314+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:50.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:50.662+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:51.332 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:51.322+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:51.651 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:51.642+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:52.286 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:52.278+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:52.687 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:52.678+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:53.244 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:53.234+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:53.650 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:53.638+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:54.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:54.226+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:54.622 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:54.614+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:55.232 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:55.222+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:55.618 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:55.606+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:56.273 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:56.262+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:56.649 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:56.638+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:57.244 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:57.234+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:57.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:57.658+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:58.252 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:58.242+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:58.685 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:58.674+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:57:59.226 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:57:59.214+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:57:59.706 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:57:59.698+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:00.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:00.186+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:00.754 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:00.746+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:01.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:01.234+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:01.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:01.750+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:02.238 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:02.226+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:02.780 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:02.770+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:03.248 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:03.238+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:03.772 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:03.762+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:04.246 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:04.238+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:04.734 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:04.722+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:05.257 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:05.246+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:05.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:05.746+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:06.214 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:06.206+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:06.724 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:06.714+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:07.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:07.246+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:07.772 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:07.762+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:08.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:08.250+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:08.765 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:08.754+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:09.300 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:09.290+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:09.733 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:09.722+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:10.311 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:10.302+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:10.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:10.750+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:11.316 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:11.306+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:11.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:11.774+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:12.367 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:12.358+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:12.753 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:12.742+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:13.338 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:13.326+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:13.712 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:13.702+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:14.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:14.298+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:14.685 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:14.674+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:15.321 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:15.310+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:15.698 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:15.686+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:16.325 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:16.314+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:16.696 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:16.686+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:17.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:17.354+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:17.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:17.666+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:18.414 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:18.402+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:18.631 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:18.622+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:19.366 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:19.358+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:19.597 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:19.586+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:20.366 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:20.354+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:20.584 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:20.574+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:21.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:21.386+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:21.572 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:21.562+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:22.427 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:22.418+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:22.608 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:22.598+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:23.408 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:23.398+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:23.594 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:23.582+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:24.409 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:24.398+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:24.591 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:24.582+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:25.440 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:25.430+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:25.593 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:25.582+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:26.467 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:26.458+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:26.588 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:26.578+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:27.499 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:27.490+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:27.571 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:27.562+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:28.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:28.502+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:28.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:28.550+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:29.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:29.530+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:29.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:29.550+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:30.492 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:30.482+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:30.530 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:30.522+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:31.494 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:31.486+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:31.533 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:31.522+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:32.526 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:32.514+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:32.549 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:32.538+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:33.518 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:33.506+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:33.524 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:33.514+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:34.497 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:34.486+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:34.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:34.538+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:35.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:35.442+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:35.504 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:35.494+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:36.464 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:36.454+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:36.477 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:36.466+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:37.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:37.462+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:37.525 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:37.514+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:38.471 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:38.462+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:38.483 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:38.474+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:39.433 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:39.422+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:39.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:39.430+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:40.456 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:40.446+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:40.476 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:40.466+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:41.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:41.406+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:41.521 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:41.510+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:42.405 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:42.394+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:42.483 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:42.474+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:43.402 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:43.390+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:43.527 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:43.518+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:44.389 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:44.378+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:44.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:44.498+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:45.408 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:45.398+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:45.461 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:45.450+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:46.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:46.366+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:46.493 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:46.482+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:47.424 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:47.414+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:47.541 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:47.530+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:48.386 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:48.374+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:48.562 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:48.550+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:49.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:49.394+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:49.566 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:49.554+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:50.421 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:50.410+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:50.592 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:50.582+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:51.430 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:51.418+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:51.633 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:51.622+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:52.450 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:52.438+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:52.620 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:52.610+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:53.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:53.462+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:53.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:53.654+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:54.506 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:54.498+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:54.653 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:54.642+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:55.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:55.470+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:55.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:55.674+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:56.451 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:56.442+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:56.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:56.658+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:57.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:57.394+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:57.629 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:57.618+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:58.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:58.394+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:58.610 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:58.598+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:58:59.404 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:58:59.394+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:58:59.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:58:59.594+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:00.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:00.394+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:00.598 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:00.586+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:01.421 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:01.410+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:01.629 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:01.618+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:02.387 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:02.378+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:02.618 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:02.606+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:03.402 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:03.394+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:03.619 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:03.610+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:04.412 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:04.402+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:04.580 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:04.570+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:05.442 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:05.434+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:05.562 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:05.550+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:06.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:06.426+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:06.519 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:06.510+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:07.402 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:07.394+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:07.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:07.530+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:08.404 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:08.394+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:08.520 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:08.510+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:09.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:09.422+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:09.551 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:09.542+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:10.453 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:10.442+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:10.514 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:10.506+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:11.422 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:11.414+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:11.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:11.546+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:12.461 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:12.450+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:12.510 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:12.502+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:13.424 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:13.414+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:13.469 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:13.458+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:14.469 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:14.458+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:14.487 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:14.478+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:15.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:15.430+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:15.515 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:15.506+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:16.415 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:16.406+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:16.508 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:16.498+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:17.406 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:17.394+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:17.499 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:17.490+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:18.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:18.414+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:18.532 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:18.522+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:19.449 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:19.438+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:19.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:19.554+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:20.446 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:20.434+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:20.611 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:20.602+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:21.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:21.390+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:21.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:21.566+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:22.400 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:22.390+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:22.552 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:22.542+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:23.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:23.346+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:23.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:23.554+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:24.313 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:24.302+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:24.520 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:24.510+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:25.293 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:25.282+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:25.546 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:25.534+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:26.254 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:26.246+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:26.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:26.582+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:27.247 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:27.238+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:27.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:27.614+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:28.259 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:28.250+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:28.646 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:28.634+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:29.234 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:29.222+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:29.646 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:29.634+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:30.188 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:30.178+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:30.632 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:30.622+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:31.145 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:31.134+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:31.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:31.606+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:32.177 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:32.166+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:32.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:32.566+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:33.207 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:33.198+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:33.625 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:33.614+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:34.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:34.214+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:34.612 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:34.602+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:35.258 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:35.246+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:35.591 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:35.582+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:36.228 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:36.218+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:36.579 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:36.570+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:37.233 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:37.221+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:37.620 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:37.609+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:38.229 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:38.217+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:38.639 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:38.629+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:39.271 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:39.261+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:39.652 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:39.641+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:40.315 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:40.305+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:40.675 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:40.665+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:41.291 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:41.281+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:41.701 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:41.689+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:42.266 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:42.257+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:42.678 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:42.669+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:43.271 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:43.261+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:43.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:43.697+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:44.293 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:44.281+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:44.689 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:44.677+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:45.335 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:45.325+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:45.663 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:45.653+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:46.339 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:46.329+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:46.635 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:46.625+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:47.291 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:47.281+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:47.676 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:47.669+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:48.289 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:48.281+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:48.657 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:48.649+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:49.250 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:49.237+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:49.638 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:49.629+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:50.224 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:50.213+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:50.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:50.585+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:51.207 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:51.201+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:51.556 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:51.549+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:52.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:52.153+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:52.565 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:52.557+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:53.145 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:53.137+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:53.547 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:53.541+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:54.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:54.157+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:54.532 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:54.525+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:55.140 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:55.133+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:55.570 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:55.561+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:56.133 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:56.125+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:56.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:56.557+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:57.117 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:57.109+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:57.553 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:57.545+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:58.123 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:58.117+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:58.557 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:58.549+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T01:59:59.104 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T01:59:59.097+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T01:59:59.511 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T01:59:59.505+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:00.065 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:00.057+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:00.543 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:00.537+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:01.036 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:01.029+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:01.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:01.505+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:02.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:01.997+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:02.554 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:02.549+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:02.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:02.981+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:03.552 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:03.545+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:04.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:04.009+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:04.553 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:04.545+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:05.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:04.997+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:05.561 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:05.553+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:06.036 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:06.029+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:06.568 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:06.561+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:07.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:07.077+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:07.526 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:07.517+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:08.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:08.077+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:08.529 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:08.521+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:09.046 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:09.041+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:09.493 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:09.485+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:10.070 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:10.061+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:10.508 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:10.501+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:11.119 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:11.113+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:11.528 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:11.521+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:12.159 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:12.153+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:12.491 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:12.485+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:13.135 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:13.129+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:13.521 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:13.513+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:14.115 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:14.109+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:14.477 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:14.469+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:15.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:15.105+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:15.492 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:15.485+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:16.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:16.109+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:16.531 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:16.525+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:17.068 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:17.061+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:17.529 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:17.521+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:18.119 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:18.113+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:18.542 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:18.533+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:19.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:19.077+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:19.503 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:19.497+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:20.107 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:20.101+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:20.455 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:20.449+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:21.111 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:21.105+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:21.452 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:21.445+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:22.125 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:22.117+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:22.448 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:22.441+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:23.144 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:23.137+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:23.450 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:23.445+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:24.169 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:24.161+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:24.425 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:24.417+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:25.211 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:25.205+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:25.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:25.453+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:26.181 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:26.173+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:26.500 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:26.493+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:27.208 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:27.201+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:27.529 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:27.521+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:28.227 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:28.221+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:28.484 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:28.477+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:29.231 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:29.225+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:29.522 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:29.513+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:30.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:30.181+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:30.484 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:30.477+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:31.185 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:31.177+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:31.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:31.465+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:32.214 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:32.209+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:32.453 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:32.445+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:33.237 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:33.229+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:33.497 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:33.489+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:34.209 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:34.201+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:34.525 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:34.517+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:35.203 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:35.197+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:35.547 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:35.541+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:36.188 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:36.181+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:36.536 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:36.529+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:37.167 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:37.161+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:37.502 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:37.493+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:38.157 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:38.149+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:38.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:38.521+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:39.149 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:39.141+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:39.517 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:39.509+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:40.144 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:40.137+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:40.490 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:40.481+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:41.132 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:41.125+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:41.525 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:41.517+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:42.147 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:42.141+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:42.492 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:42.485+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:43.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:43.145+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:43.466 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:43.457+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:44.149 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:44.141+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:44.499 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:44.493+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:45.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:45.109+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:45.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:45.505+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:46.128 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:46.121+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:46.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:46.465+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:47.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:47.097+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:47.517 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:47.509+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:48.112 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:48.105+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:48.509 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:48.501+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:49.113 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:49.105+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:49.468 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:49.461+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:50.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:50.065+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:50.507 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:50.501+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:51.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:51.037+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:51.494 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:51.485+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:52.031 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:52.025+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:52.498 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:52.489+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:53.034 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:53.029+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:53.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:53.477+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:54.055 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:54.049+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:54.457 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:54.449+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:55.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:55.017+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:55.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:55.409+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:56.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:55.993+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:56.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:56.433+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:57.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:57.009+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:57.465 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:57.457+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:57.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:57.981+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:58.426 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:58.417+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:00:58.994 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:00:58.985+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:00:59.424 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:00:59.417+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:00.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:00.005+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:00.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:00.381+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:00.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:00.985+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:01.422 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:01.413+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:01.985 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:01.977+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:02.424 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:02.417+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:03.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:02.997+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:03.379 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:03.373+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:04.040 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:04.033+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:04.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:04.377+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:05.045 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:05.037+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:05.430 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:05.421+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:06.035 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:06.029+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:06.421 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:06.413+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:07.062 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:07.053+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:07.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:07.397+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:08.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:08.013+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:08.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:08.405+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:09.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:09.029+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:09.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:09.385+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:10.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:10.005+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:10.408 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:10.401+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:10.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:10.993+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:11.418 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:11.409+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:12.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:11.993+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:12.457 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:12.449+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:13.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:13.005+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:13.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:13.429+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:14.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:14.005+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:14.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:14.405+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:15.009 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:15.001+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:15.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:15.377+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:16.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:16.021+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:16.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:16.417+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:17.035 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:17.029+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:17.433 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:17.425+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:18.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:18.037+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:18.421 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:18.413+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:19.027 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:19.021+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:19.465 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:19.457+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:20.008 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:20.001+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:20.488 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:20.481+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:20.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:20.981+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:21.445 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:21.437+0000 7f0e4c437700 -1 osd.1 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:22.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:21.997+0000 7fe9a9d5f700 -1 osd.0 157 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:22.481 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:22.473+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:23.053 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:23.044+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:23.491 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:23.484+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:24.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:24.060+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:24.523 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:24.516+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:25.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:25.032+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:25.503 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:25.496+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:26.009 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:26.000+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:26.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:26.476+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:27.049 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:27.040+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:27.490 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:27.480+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:28.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:28.004+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:28.467 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:28.460+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:28.992 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:28.984+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:29.457 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:29.448+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:29.944 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:29.936+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:30.488 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:30.480+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:30.914 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:30.908+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:31.515 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:31.508+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:31.922 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:31.912+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:32.487 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:32.480+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:32.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:32.936+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:33.530 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:33.520+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:33.938 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:33.928+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:34.579 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:34.572+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:34.984 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:34.976+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:35.540 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:35.532+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:35.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:35.992+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:36.568 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:36.560+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:37.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:37.004+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:37.600 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:37.592+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:38.027 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:38.020+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:38.557 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:38.548+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:38.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:38.972+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:39.521 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:39.512+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:39.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:39.944+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:40.529 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:40.520+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:40.929 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:40.920+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:41.516 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:41.508+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:41.911 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:41.904+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:42.533 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:42.524+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:42.960 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:42.952+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:43.559 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:43.548+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:43.965 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:43.956+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:44.597 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:44.588+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:44.961 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:44.952+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:45.572 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:45.564+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:45.946 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:45.936+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:46.528 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:46.516+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:46.958 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:46.948+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:47.544 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:47.536+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:47.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:47.908+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:48.565 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:48.556+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:48.957 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:48.948+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:49.610 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:49.600+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:49.966 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:49.956+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:50.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:50.608+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:50.925 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:50.916+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:51.570 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:51.560+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:51.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:51.868+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:52.542 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:52.532+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:52.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:52.844+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:53.581 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:53.572+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:53.885 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:53.876+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:54.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:54.540+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:54.921 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:54.912+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:55.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:55.508+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:55.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:55.944+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:56.524 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:56.516+0000 7f0e4c437700 -1 osd.1 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:56.913 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:56.904+0000 7fe9a9d5f700 -1 osd.0 158 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:57.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:57.476+0000 7f0e4c437700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:57.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:57.920+0000 7fe9a9d5f700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:58.458 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:58.448+0000 7f0e4c437700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:58.958 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:58.948+0000 7fe9a9d5f700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:01:59.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:01:59.428+0000 7f0e4c437700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:01:59.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:01:59.956+0000 7fe9a9d5f700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:00.392 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:00.384+0000 7f0e4c437700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:01.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:01.004+0000 7fe9a9d5f700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:01.394 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:01.384+0000 7f0e4c437700 -1 osd.1 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:01.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:01.964+0000 7fe9a9d5f700 -1 osd.0 159 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:02.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:02.392+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:03.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:02.996+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:03.355 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:03.348+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:04.040 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:04.032+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:04.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:04.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:05.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:04.996+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:05.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:05.340+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:05.976 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:05.968+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:06.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:06.368+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:07.020 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:07.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:07.343 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:07.336+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:08.062 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:08.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:08.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:08.304+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:09.086 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:09.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:09.337 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:09.328+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:10.112 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:10.104+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:10.308 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:10.300+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:11.099 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:11.092+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:11.343 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:11.336+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:12.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:12.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:12.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:12.344+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:13.112 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:13.104+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:13.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:13.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:14.164 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:14.156+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:14.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:14.376+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:15.140 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:15.132+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:15.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:15.348+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:16.095 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:16.088+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:16.399 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:16.392+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:17.129 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:17.120+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:17.425 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:17.416+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:18.130 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:18.124+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:18.398 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:18.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:19.165 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:19.156+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:19.411 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:19.404+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:20.173 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:20.164+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:20.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:20.364+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:21.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:21.156+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:21.402 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:21.396+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:22.125 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:22.116+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:22.368 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:22.360+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:23.088 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:23.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:23.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:23.328+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:24.098 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:24.088+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:24.320 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:24.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:25.137 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:25.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:25.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:25.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:26.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:26.084+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:26.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:26.324+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:27.103 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:27.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:27.342 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:27.332+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:28.145 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:28.136+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:28.322 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:28.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:29.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:29.120+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:29.287 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:29.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:30.154 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:30.144+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:30.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:30.320+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:31.202 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:31.196+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:31.299 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:31.292+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:32.244 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:32.236+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:32.299 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:32.292+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:33.236 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:33.228+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:33.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:33.308+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:34.214 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:34.204+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:34.278 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:34.272+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:35.199 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:35.192+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:35.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:35.296+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:36.204 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:36.196+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:36.326 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:36.316+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:37.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:37.204+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:37.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:37.368+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:38.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:38.184+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:38.394 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:38.384+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:39.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:39.144+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:39.428 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:39.420+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:40.174 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:40.168+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:40.387 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:40.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:41.148 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:41.140+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:41.398 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:41.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:42.162 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:42.156+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:42.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:42.416+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:43.144 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:43.136+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:43.379 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:43.372+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:44.152 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:44.144+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:44.343 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:44.336+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:45.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:45.100+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:45.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:45.316+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:46.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:46.056+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:46.284 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:46.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:47.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:47.028+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:47.332 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:47.324+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:48.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:47.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:48.369 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:48.360+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:48.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:48.980+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:49.420 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:49.412+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:50.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:50.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:50.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:50.364+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:51.020 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:51.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:51.422 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:51.412+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:52.047 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:52.040+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:52.445 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:52.436+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:53.093 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:53.084+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:53.457 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:53.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:54.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:54.056+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:54.508 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:54.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:55.089 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:55.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:55.467 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:55.460+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:56.129 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:56.120+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:56.467 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:56.460+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:57.172 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:57.164+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:57.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:57.472+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:58.218 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:58.212+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:58.517 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:58.508+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:02:59.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:02:59.200+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:02:59.531 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:02:59.524+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:00.216 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:00.208+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:00.571 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:00.564+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:01.226 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:01.216+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:01.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:01.596+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:02.232 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:02.224+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:02.606 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:02.596+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:03.212 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:03.204+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:03.652 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:03.644+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:04.198 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:04.188+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:04.651 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:04.644+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:05.197 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:05.188+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:05.643 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:05.636+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:06.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:06.184+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:06.682 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:06.672+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:07.216 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:07.208+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:07.658 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:07.648+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:08.254 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:08.248+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:08.652 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:08.644+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:09.244 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:09.236+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:09.621 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:09.612+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:10.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:10.188+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:10.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:10.596+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:11.156 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:11.148+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:11.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:11.596+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:12.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:12.120+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:12.579 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:12.572+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:13.164 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:13.156+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:13.571 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:13.564+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:14.155 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:14.148+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:14.581 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:14.572+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:15.198 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:15.188+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:15.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:15.568+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:16.226 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:16.220+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:16.609 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:16.600+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:17.258 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:17.252+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:17.652 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:17.644+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:18.302 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:18.296+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:18.679 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:18.672+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:19.301 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:19.292+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:19.645 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:19.636+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:20.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:20.304+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:20.644 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:20.636+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:21.340 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:21.332+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:21.678 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:21.668+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:22.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:22.384+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:22.711 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:22.704+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:23.374 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:23.364+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:23.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:23.700+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:24.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:24.396+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:24.754 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:24.744+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:25.448 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:25.440+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:25.728 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:25.720+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:26.406 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:26.400+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:26.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:26.700+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:27.434 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:27.424+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:27.684 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:27.676+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:28.398 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:28.392+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:28.734 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:28.728+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:29.414 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:29.408+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:29.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:29.700+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:30.413 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:30.404+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:30.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:30.700+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:31.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:31.432+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:31.697 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:31.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:32.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:32.420+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:32.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:32.732+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:33.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:33.424+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:33.719 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:33.712+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:34.414 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:34.408+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:34.738 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:34.732+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:35.399 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:35.392+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:35.758 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:35.752+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:36.425 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:36.416+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:36.771 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:36.764+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:37.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:37.412+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:37.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:37.732+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:38.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:38.384+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:38.726 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:38.720+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:39.403 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:39.396+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:39.752 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:39.744+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:40.372 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:40.364+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:40.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:40.776+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:41.338 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:41.328+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:41.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:41.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:42.336 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:42.328+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:42.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:42.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:43.303 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:43.296+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:43.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:43.844+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:44.305 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:44.296+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:44.848 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:44.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:45.268 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:45.260+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:45.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:45.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:46.257 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:46.248+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:46.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:46.788+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:47.307 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:47.300+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:47.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:47.796+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:48.348 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:48.340+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:48.797 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:48.788+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:49.385 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:49.376+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:49.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:49.828+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:50.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:50.412+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:50.869 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:50.860+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:51.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:51.460+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:51.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:51.844+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:52.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:52.420+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:52.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:52.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:53.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:53.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:53.902 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:53.896+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:54.452 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:54.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:54.868 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:54.860+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:55.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:55.448+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:55.911 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:55.904+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:56.482 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:56.472+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:56.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:56.908+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:57.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:57.448+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:57.878 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:57.872+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:58.435 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:58.428+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:58.928 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:58.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:03:59.398 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:03:59.392+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:03:59.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:03:59.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:00.363 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:00.356+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:00.885 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:00.876+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:01.329 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:01.320+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:01.913 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:01.904+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:02.293 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:02.284+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:02.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:02.944+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:03.274 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:03.263+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:03.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:03.935+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:04.274 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:04.267+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:04.960 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:04.951+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:05.234 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:05.223+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:05.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:05.931+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:06.197 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:06.187+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:06.899 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:06.891+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:07.239 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:07.231+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:07.896 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:07.887+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:08.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:08.215+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:08.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:08.903+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:09.269 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:09.259+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:09.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:09.899+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:10.296 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:10.287+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:10.935 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:10.927+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:11.307 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:11.299+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:11.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:11.935+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:12.320 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:12.311+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:12.961 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:12.951+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:13.367 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:13.359+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:13.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:13.919+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:14.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:14.355+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:14.936 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:14.927+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:15.400 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:15.391+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:15.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:15.963+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:16.399 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:16.391+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:16.993 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:16.983+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:17.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:17.411+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:17.992 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:17.983+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:18.442 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:18.431+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:18.954 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:18.943+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:19.396 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:19.387+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:19.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:19.923+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:20.380 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:20.371+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:20.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:20.887+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:21.343 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:21.335+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:21.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:21.843+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:22.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:22.351+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:22.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:22.875+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:23.389 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:23.379+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:23.868 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:23.859+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:24.371 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:24.359+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:24.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:24.819+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:25.376 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:25.367+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:25.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:25.803+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:26.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:26.347+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:26.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:26.795+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:27.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:27.383+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:27.761 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:27.751+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:28.386 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:28.379+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:28.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:28.727+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:29.390 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:29.383+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:29.758 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:29.751+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:30.428 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:30.419+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:30.724 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:30.715+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:31.467 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:31.459+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:31.700 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:31.691+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:32.451 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:32.443+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:32.660 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:32.651+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:33.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:33.459+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:33.667 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:33.659+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:34.469 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:34.459+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:34.673 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:34.663+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:35.511 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:35.503+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:35.639 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:35.631+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:36.547 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:36.539+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:36.599 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:36.591+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:37.569 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:37.559+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:37.578 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:37.567+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:38.536 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:38.527+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:38.605 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:38.595+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:39.572 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:39.563+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:39.583 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:39.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:40.538 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:40.531+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:40.595 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:40.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:41.496 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:41.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:41.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:41.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:42.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:42.535+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:42.607 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:42.599+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:43.515 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:43.507+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:43.611 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:43.603+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:44.512 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:44.503+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:44.659 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:44.651+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:45.483 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:45.475+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:45.682 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:45.675+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:46.506 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:46.499+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:46.640 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:46.631+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:47.476 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:47.467+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:47.606 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:47.595+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:48.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:48.459+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:48.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:48.579+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:49.431 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:49.423+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:49.597 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:49.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:50.469 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:50.459+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:50.593 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:50.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:51.447 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:51.439+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:51.597 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:51.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:52.493 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:52.483+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:52.557 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:52.547+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:53.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:53.491+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:53.587 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:53.579+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:54.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:54.531+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:54.639 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:54.631+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:55.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:55.519+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:55.634 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:55.627+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:56.490 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:56.483+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:56.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:56.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:57.517 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:57.507+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:57.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:57.595+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:58.531 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:58.523+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:58.622 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:58.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:04:59.543 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:04:59.535+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:04:59.622 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:04:59.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:00.594 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:00.587+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:00.651 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:00.643+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:01.586 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:01.579+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:01.641 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:01.631+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:02.587 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:02.579+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:02.629 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:02.619+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:03.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:03.607+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:03.627 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:03.619+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:04.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:04.627+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:04.645 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:04.635+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:05.646 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:05.639+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:05.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:05.679+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:06.626 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:06.619+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:06.681 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:06.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:07.592 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:07.583+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:07.675 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:07.667+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:08.563 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:08.555+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:08.720 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:08.711+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:09.530 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:09.523+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:09.756 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:09.747+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:10.572 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:10.563+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:10.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:10.783+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:11.567 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:11.559+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:11.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:11.771+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:12.570 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:12.563+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:12.798 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:12.791+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:13.616 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:13.607+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:13.845 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:13.835+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:14.578 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:14.571+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:14.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:14.803+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:15.561 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:15.551+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:15.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:15.783+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:16.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:16.527+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:16.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:16.831+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:17.541 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:17.531+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:17.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:17.803+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:18.557 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:18.547+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:18.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:18.775+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:19.569 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:19.559+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:19.738 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:19.731+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:20.525 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:20.515+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:20.750 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:20.743+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:21.527 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:21.519+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:21.762 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:21.755+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:22.480 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:22.471+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:22.778 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:22.771+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:23.499 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:23.491+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:23.792 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:23.783+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:24.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:24.499+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:24.765 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:24.755+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:25.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:25.455+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:25.767 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:25.759+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:26.502 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:26.495+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:26.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:26.775+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:27.470 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:27.463+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:27.760 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:27.751+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:28.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:28.499+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:28.790 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:28.779+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:29.513 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:29.503+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:29.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:29.787+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:30.472 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:30.463+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:30.832 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:30.823+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:31.482 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:31.475+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:31.788 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:31.779+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:32.529 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:32.519+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:32.760 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:32.751+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:33.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:33.551+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:33.776 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:33.767+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:34.568 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:34.559+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:34.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:34.795+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:35.523 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:35.515+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:35.790 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:35.783+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:36.525 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:36.515+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:36.748 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:36.739+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:37.520 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:37.511+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:37.701 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:37.691+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:38.531 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:38.523+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:38.682 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:38.675+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:39.498 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:39.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:39.678 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:39.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:40.504 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:40.495+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:40.694 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:40.687+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:41.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:41.455+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:41.681 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:41.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:42.496 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:42.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:42.708 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:42.699+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:43.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:43.519+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:43.671 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:43.663+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:44.478 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:44.471+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:44.668 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:44.659+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:45.497 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:45.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:45.622 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:45.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:46.479 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:46.471+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:46.601 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:46.591+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:47.447 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:47.439+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:47.569 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:47.559+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:48.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:48.455+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:48.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:48.607+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:49.479 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:49.471+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:49.574 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:49.567+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:50.442 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:50.435+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:50.540 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:50.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:51.476 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:51.467+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:51.573 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:51.563+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:52.501 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:52.491+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:52.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:52.607+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:53.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:53.455+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:53.618 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:53.611+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:54.456 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:54.447+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:54.577 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:54.567+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:55.481 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:55.471+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:55.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:55.555+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:56.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:56.431+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:56.594 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:56.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:57.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:57.455+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:57.557 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:57.547+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:58.492 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:58.483+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:58.514 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:58.507+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:05:59.538 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:05:59.531+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:05:59.558 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:05:59.551+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:00.580 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:00.571+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:00.586 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:00.579+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:01.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:01.595+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:01.625 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:01.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:02.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:02.623+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:02.643 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:02.635+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:03.641 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:03.631+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:03.677 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:03.667+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:04.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:04.627+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:04.723 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:04.715+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:05.618 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:05.611+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:05.766 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:05.759+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:06.651 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:06.643+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:06.751 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:06.743+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:07.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:07.667+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:07.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:07.739+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:08.648 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:08.639+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:08.740 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:08.731+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:09.658 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:09.651+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:09.769 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:09.759+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:10.706 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:10.699+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:10.740 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:10.731+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:11.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:11.687+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:11.703 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:11.695+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:12.700 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:12.691+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:12.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:12.691+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:13.659 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:13.651+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:13.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:13.663+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:14.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:14.659+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:14.675 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:14.667+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:15.640 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:15.631+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:15.650 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:15.643+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:16.643 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:16.635+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:16.684 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:16.675+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:17.675 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:17.667+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:17.725 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:17.715+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:18.662 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:18.655+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:18.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:18.767+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:19.686 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:19.679+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:19.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:19.795+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:20.666 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:20.659+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:20.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:20.783+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:21.692 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:21.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:21.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:21.759+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:22.728 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:22.719+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:22.813 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:22.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:23.773 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:23.763+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:23.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:23.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:24.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:24.775+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:24.875 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:24.867+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:25.806 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:25.799+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:25.838 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:25.831+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:26.777 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:26.767+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:26.879 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:26.871+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:27.780 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:27.771+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:27.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:27.911+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:28.808 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:28.799+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:28.894 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:28.883+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:29.832 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:29.823+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:29.905 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:29.895+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:30.838 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:30.831+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:30.944 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:30.935+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:31.863 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:31.855+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:31.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:31.979+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:32.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:32.883+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:32.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:32.987+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:33.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:33.903+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:33.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:33.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:34.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:34.895+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:34.946 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:34.939+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:35.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:35.887+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:35.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:35.891+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:36.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:36.935+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:36.946 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:36.939+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:37.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:37.919+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:37.981 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:37.971+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:38.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:38.934+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:38.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:38.942+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:39.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:39.906+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:39.976 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:39.966+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:40.871 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:40.862+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:40.951 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:40.942+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:41.899 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:41.890+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:41.914 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:41.906+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:42.880 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:42.870+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:42.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:42.906+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:43.879 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:43.870+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:43.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:43.942+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:44.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:44.882+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:44.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:44.946+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:45.881 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:45.874+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:45.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:45.946+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:46.911 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:46.902+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:46.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:46.906+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:47.897 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:47.886+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:47.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:47.946+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:48.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:48.842+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:48.937 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:48.930+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:49.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:49.798+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:49.897 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:49.886+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:50.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:50.830+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:50.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:50.894+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:51.843 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:51.834+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:51.890 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:51.882+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:52.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:52.838+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:52.909 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:52.898+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:53.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:53.814+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:53.902 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:53.894+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:54.814 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:54.806+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:54.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:54.886+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:55.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:55.758+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:55.868 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:55.858+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:56.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:56.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:56.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:56.814+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:57.800 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:57.790+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:57.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:57.826+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:58.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:58.774+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:58.839 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:58.830+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:06:59.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:06:59.770+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:06:59.891 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:06:59.882+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:00.749 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:00.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:00.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:00.842+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:01.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:01.702+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:01.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:01.810+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:02.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:02.690+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:02.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:02.786+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:03.722 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:03.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:03.839 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:03.830+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:04.773 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:04.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:04.865 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:04.858+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:05.802 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:05.794+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:05.885 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:05.874+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:06.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:06.766+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:06.900 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:06.890+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:07.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:07.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:07.937 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:07.930+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:08.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:08.774+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:08.981 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:08.970+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:09.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:09.770+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:09.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:09.930+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:10.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:10.778+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:10.911 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:10.902+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:11.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:11.802+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:11.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:11.902+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:12.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:12.782+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:12.891 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:12.882+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:13.742 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:13.734+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:13.898 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:13.890+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:14.695 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:14.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:14.902 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:14.894+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:15.690 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:15.682+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:15.942 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:15.934+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:16.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:16.702+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:16.946 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:16.938+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:17.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:17.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:17.913 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:17.902+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:18.752 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:18.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:18.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:18.946+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:19.764 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:19.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:19.923 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:19.914+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:20.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:20.726+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:20.924 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:20.914+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:21.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:21.722+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:21.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:21.962+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:22.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:22.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:22.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:22.966+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:23.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:23.790+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:23.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:23.938+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:24.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:24.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:24.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:24.906+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:25.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:25.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:25.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:25.922+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:26.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:26.774+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:26.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:26.926+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:27.761 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:27.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:27.921 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:27.910+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:28.775 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:28.766+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:28.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:28.930+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:29.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:29.722+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:29.891 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:29.882+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:30.721 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:30.710+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:30.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:30.926+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:31.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:31.666+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:31.907 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:31.898+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:32.637 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:32.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:32.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:32.938+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:33.646 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:33.638+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:33.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:33.922+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:34.637 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:34.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:34.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:34.914+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:35.671 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:35.662+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:35.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:35.938+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:36.639 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:36.630+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:36.969 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:36.958+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:37.668 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:37.658+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:37.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:37.958+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:38.691 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:38.682+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:38.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:38.970+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:39.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:39.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:39.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:39.934+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:40.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:40.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:40.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:40.934+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:41.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:41.710+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:41.971 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:41.962+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:42.684 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:42.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:42.984 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:42.974+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:43.650 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:43.642+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:43.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:43.934+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:44.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:44.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:44.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:44.970+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:45.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:45.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:46.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:46.010+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:46.714 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:46.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:47.068 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:47.058+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:47.749 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:47.738+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:48.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:48.074+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:48.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:48.778+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:49.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:49.086+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:49.794 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:49.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:50.139 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:50.130+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:50.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:50.810+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:51.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:51.166+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:51.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:51.850+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:52.129 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:52.118+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:52.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:52.858+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:53.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:53.126+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:53.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:53.902+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:54.111 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:54.102+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:54.925 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:54.914+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:55.127 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:55.118+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:55.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:55.926+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:56.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:56.130+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:56.957 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:56.946+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:57.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:57.106+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:57.998 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:57.986+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:58.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:58.074+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:07:59.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:07:59.030+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:07:59.115 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:07:59.106+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:00.064 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:00.054+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:00.114 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:00.106+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:01.052 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:01.042+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:01.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:01.094+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:02.059 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:02.050+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:02.133 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:02.122+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:03.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:03.018+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:03.171 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:03.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:04.081 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:04.070+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:04.174 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:04.166+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:05.098 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:05.090+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:05.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:05.130+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:06.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:06.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:06.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:06.142+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:07.104 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:07.094+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:07.139 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:07.130+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:08.138 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:08.130+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:08.173 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:08.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:09.113 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:09.102+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:09.218 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:09.210+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:10.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:10.106+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:10.222 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:10.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:11.131 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:11.122+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:11.183 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:11.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:12.108 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:12.098+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:12.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:12.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:13.106 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:13.094+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:13.174 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:13.166+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:14.129 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:14.118+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:14.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:14.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:15.163 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:15.154+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:15.172 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:15.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:16.154 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:16.146+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:16.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:16.194+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:17.130 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:17.122+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:17.228 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:17.218+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:18.124 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:18.114+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:18.254 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:18.246+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:19.120 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:19.110+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:19.214 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:19.206+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:20.119 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:20.110+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:20.171 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:20.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:21.128 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:21.118+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:21.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:21.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:22.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:22.150+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:22.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:22.166+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:23.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:23.182+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:23.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:23.202+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:24.157 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:24.146+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:24.257 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:24.250+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:25.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:25.170+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:25.234 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:25.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:26.170 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:26.162+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:26.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:26.262+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:27.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:27.202+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:27.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:27.222+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:28.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:28.210+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:28.268 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:28.250+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:29.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:29.202+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:29.215 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:29.206+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:30.163 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:30.154+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:30.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:30.186+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:31.150 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:31.142+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:31.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:31.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:32.147 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:32.138+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:32.148 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:32.138+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:33.107 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:33.098+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:33.147 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:33.138+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:34.122 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:34.114+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:34.174 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:34.166+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:35.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:35.118+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:35.169 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:35.158+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:36.100 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:36.090+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:36.128 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:36.118+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:37.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:37.082+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:37.145 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:37.134+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:38.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:38.090+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:38.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:38.150+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:39.068 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:39.058+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:39.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:39.178+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:40.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:40.022+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:40.140 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:40.130+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:41.046 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:41.038+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:41.097 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:41.086+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:42.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:41.990+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:42.126 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:42.118+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:43.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:42.998+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:43.176 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:43.166+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:44.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:44.010+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:44.158 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:44.150+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:44.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:44.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:45.208 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:45.197+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:45.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:45.929+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:46.215 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:46.205+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:46.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:46.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:47.220 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:47.209+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:47.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:47.949+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:48.173 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:48.161+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:48.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:48.949+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:49.204 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:49.193+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:49.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:49.905+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:50.173 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:50.161+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:50.960 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:50.949+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:51.179 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:51.169+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:51.935 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:51.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:52.183 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:52.173+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:52.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:52.909+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:53.208 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:53.197+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:53.873 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:53.865+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:54.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:54.181+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:54.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:54.833+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:55.243 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:55.233+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:55.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:55.785+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:56.204 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:56.193+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:56.778 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:56.769+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:57.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:57.229+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:57.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:57.817+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:58.254 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:58.245+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:58.809 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:58.801+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:08:59.248 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:08:59.241+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:08:59.787 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:08:59.781+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:00.242 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:00.237+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:00.773 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:00.765+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:01.278 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:01.273+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:01.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:01.733+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:02.250 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:02.245+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:02.772 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:02.765+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:03.249 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:03.241+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:03.733 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:03.725+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:04.240 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:04.233+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:04.748 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:04.741+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:05.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:05.189+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:05.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:05.777+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:06.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:06.185+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:06.829 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:06.821+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:07.145 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:07.137+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:07.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:07.845+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:08.120 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:08.113+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:08.899 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:08.893+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:09.080 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:09.073+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:09.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:09.901+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:10.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:10.065+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:10.887 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:10.881+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:11.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:11.101+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:11.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:11.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:12.132 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:12.125+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:12.923 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:12.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:13.184 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:13.177+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:13.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:13.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:14.161 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:14.153+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:14.950 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:14.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:15.120 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:15.113+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:15.921 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:15.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:16.101 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:16.093+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:16.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:16.937+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:17.130 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:17.125+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:17.983 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:17.977+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:18.121 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:18.113+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:19.004 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:18.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:19.125 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:19.117+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:20.008 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:20.001+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:20.141 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:20.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:20.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:20.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:21.177 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:21.169+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:21.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:21.937+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:22.211 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:22.205+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:22.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:22.937+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:23.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:23.189+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:23.973 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:23.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:24.165 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:24.157+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:25.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:25.017+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:25.123 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:25.117+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:26.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:26.037+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:26.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:26.145+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:27.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:27.065+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:27.131 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:27.125+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:28.109 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:28.101+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:28.129 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:28.121+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:29.078 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:29.073+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:29.170 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:29.165+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:30.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:30.113+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:30.156 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:30.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:31.076 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:31.069+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:31.122 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:31.117+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:32.119 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:32.113+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:32.154 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:32.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:33.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:33.133+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:33.185 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:33.177+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:34.114 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:34.109+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:34.182 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:34.177+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:35.109 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:35.101+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:35.147 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:35.141+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:36.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:36.125+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:36.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:36.181+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:37.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:37.177+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:37.200 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:37.193+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:38.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:38.181+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:38.227 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:38.221+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:39.205 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:39.197+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:39.208 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:39.201+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:40.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:40.185+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:40.256 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:40.249+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:41.213 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:41.205+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:41.239 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:41.233+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:42.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:42.205+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:42.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:42.277+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:43.169 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:43.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:43.242 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:43.237+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:44.148 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:44.141+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:44.234 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:44.229+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:45.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:45.173+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:45.248 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:45.241+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:46.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:46.201+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:46.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:46.205+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:47.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:47.181+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:47.258 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:47.253+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:48.159 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:48.153+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:48.213 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:48.209+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:49.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:49.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:49.176 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:49.169+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:50.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:50.113+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:50.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:50.205+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:51.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:51.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:51.226 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:51.221+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:52.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:52.093+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:52.181 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:52.173+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:53.133 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:53.125+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:53.213 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:53.209+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:54.106 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:54.097+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:54.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:54.189+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:55.131 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:55.125+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:55.168 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:55.161+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:56.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:56.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:56.181 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:56.173+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:57.154 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:57.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:57.196 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:57.189+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:58.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:58.101+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:58.215 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:58.209+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:09:59.099 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:09:59.093+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:09:59.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:09:59.249+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:00.147 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:00.141+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:00.241 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:00.233+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:01.137 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:01.129+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:01.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:01.261+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:02.152 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:02.145+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:02.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:02.285+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:03.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:03.145+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:03.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:03.269+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:04.125 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:04.117+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:04.305 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:04.297+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:05.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:05.073+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:05.320 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:05.313+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:06.092 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:06.085+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:06.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:06.341+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:07.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:07.061+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:07.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:07.389+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:08.079 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:08.069+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:08.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:08.373+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:09.068 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:09.061+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:09.341 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:09.333+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:10.103 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:10.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:10.343 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:10.337+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:11.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:11.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:11.391 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:11.385+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:12.123 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:12.117+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:12.416 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:12.409+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:13.090 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:13.085+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:13.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:13.397+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:14.138 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:14.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:14.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:14.393+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:15.173 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:15.165+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:15.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:15.381+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:16.158 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:16.153+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:16.420 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:16.413+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:17.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:17.189+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:17.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:17.429+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:18.181 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:18.173+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:18.424 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:18.417+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:19.135 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:19.129+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:19.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:19.373+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:20.149 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:20.141+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:20.344 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:20.337+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:21.104 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:21.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:21.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:21.317+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:22.113 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:22.105+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:22.340 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:22.333+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:23.138 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:23.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:23.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:23.369+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:24.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:24.105+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:24.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:24.389+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:25.129 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:25.121+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:25.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:25.417+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:26.172 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:26.165+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:26.449 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:26.441+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:27.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:27.145+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:27.471 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:27.465+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:28.123 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:28.117+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:28.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:28.453+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:29.133 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:29.125+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:29.462 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:29.457+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:30.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:30.109+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:30.431 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:30.425+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:31.101 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:31.093+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:31.468 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:31.461+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:32.056 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:32.049+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:32.429 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:32.421+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:33.032 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:33.025+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:33.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:33.437+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:34.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:34.005+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:34.447 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:34.441+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:34.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:34.961+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:35.439 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:35.433+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:35.944 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:35.937+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:36.428 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:36.420+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:36.913 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:36.904+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:37.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:37.428+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:37.941 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:37.928+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:38.440 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:38.432+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:38.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:38.964+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:39.454 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:39.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:40.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:39.996+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:40.460 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:40.452+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:41.042 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:41.032+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:41.505 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:41.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:42.077 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:42.068+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:42.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:42.464+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:43.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:43.108+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:43.468 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:43.460+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:44.088 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:44.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:44.458 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:44.452+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:45.041 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:45.032+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:45.447 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:45.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:45.998 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:45.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:46.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:46.400+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:46.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:46.944+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:47.428 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:47.420+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:47.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:47.964+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:48.461 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:48.456+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:48.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:48.924+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:49.508 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:49.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:49.895 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:49.888+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:50.473 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:50.464+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:50.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:50.876+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:51.447 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:51.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:51.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:51.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:52.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:52.416+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:52.921 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:52.916+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:53.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:53.424+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:53.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:53.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:54.452 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:54.444+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:54.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:54.956+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:55.434 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:55.428+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:55.961 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:55.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:56.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:56.408+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:57.008 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:57.000+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:57.421 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:57.412+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:57.966 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:57.960+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:58.383 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:58.376+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:58.961 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:58.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:10:59.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:10:59.356+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:10:59.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:10:59.928+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:00.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:00.324+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:00.933 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:00.924+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:01.284 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:01.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:01.941 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:01.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:02.302 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:02.296+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:02.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:02.960+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:03.257 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:03.248+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:04.011 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:04.004+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:04.305 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:04.296+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:05.058 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:05.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:05.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:05.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:06.045 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:06.036+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:06.338 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:06.332+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:07.034 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:07.028+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:07.330 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:07.324+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:08.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:08.008+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:08.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:08.324+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:09.040 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:09.032+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:09.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:09.376+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:09.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:09.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:10.373 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:10.364+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:10.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:10.984+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:11.325 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:11.316+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:11.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:11.972+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:12.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:12.324+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:12.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:12.980+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:13.327 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:13.320+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:13.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:13.956+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:14.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:14.344+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:14.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:14.956+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:15.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:15.348+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:15.940 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:15.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:16.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:16.392+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:16.986 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:16.980+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:17.447 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:17.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:17.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:17.964+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:18.471 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:18.464+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:19.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:18.996+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:19.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:19.428+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:20.032 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:20.024+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:20.408 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:20.400+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:21.047 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:21.040+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:21.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:21.352+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:22.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:22.064+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:22.383 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:22.376+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:23.080 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:23.072+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:23.416 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:23.408+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:24.101 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:24.092+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:24.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:24.392+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:25.131 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:25.124+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:25.448 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:25.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:26.144 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:26.136+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:26.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:26.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:27.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:27.152+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:27.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:27.428+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:28.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:28.152+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:28.447 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:28.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:29.197 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:29.184+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:29.458 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:29.452+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:30.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:30.228+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:30.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:30.464+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:31.219 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:31.212+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:31.431 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:31.424+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:32.231 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:32.224+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:32.482 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:32.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:33.216 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:33.208+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:33.460 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:33.452+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:34.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:34.188+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:34.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:34.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:35.228 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:35.220+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:35.447 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:35.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:36.244 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:36.232+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:36.482 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:36.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:37.269 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:37.260+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:37.493 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:37.484+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:38.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:38.228+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:38.512 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:38.504+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:39.224 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:39.216+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:39.536 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:39.528+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:40.227 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:40.220+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:40.560 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:40.552+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:41.249 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:41.240+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:41.526 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:41.520+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:42.232 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:42.224+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:42.546 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:42.540+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:43.270 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:43.260+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:43.532 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:43.524+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:44.295 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:44.288+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:44.509 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:44.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:45.327 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:45.320+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:45.553 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:45.544+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:46.324 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:46.316+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:46.601 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:46.592+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:47.354 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:47.348+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:47.554 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:47.544+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:48.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:48.356+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:48.561 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:48.552+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:49.365 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:49.356+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:49.593 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:49.584+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:50.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:50.356+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:50.637 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:50.628+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:51.329 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:51.320+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:51.605 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:51.596+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:52.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:52.280+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:52.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:52.596+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:53.255 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:53.248+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:53.610 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:53.604+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:54.275 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:54.268+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:54.632 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:54.624+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:55.306 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:55.300+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:55.614 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:55.608+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:56.350 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:56.344+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:56.653 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:56.644+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:57.358 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:57.352+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:57.680 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:57.672+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:58.388 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:58.380+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:58.680 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:58.672+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:11:59.389 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:11:59.380+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:11:59.653 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:11:59.644+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:00.363 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:00.356+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:00.645 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:00.636+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:01.407 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:01.400+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:01.690 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:01.684+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:02.409 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:02.400+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:02.709 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:02.700+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:03.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:03.380+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:03.747 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:03.740+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:04.360 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:04.352+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:04.769 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:04.760+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:05.342 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:05.332+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:05.781 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:05.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:06.363 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:06.356+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:06.790 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:06.784+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:07.388 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:07.380+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:07.755 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:07.748+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:08.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:08.404+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:08.769 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:08.760+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:09.447 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:09.440+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:09.778 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:09.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:10.462 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:10.452+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:10.778 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:10.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:11.427 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:11.420+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:11.731 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:11.724+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:12.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:12.428+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:12.694 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:12.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:13.414 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:13.408+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:13.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:13.680+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:14.389 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:14.380+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:14.700 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:14.692+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:15.383 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:15.376+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:15.673 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:15.664+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:16.365 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:16.356+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:16.659 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:16.652+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:17.355 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:17.348+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:17.694 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:17.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:18.406 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:18.400+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:18.743 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:18.736+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:19.368 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:19.359+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:19.723 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:19.715+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:20.372 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:20.363+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:20.686 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:20.679+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:21.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:21.339+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:21.674 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:21.667+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:22.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:22.371+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:22.656 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:22.647+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:23.330 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:23.323+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:23.669 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:23.659+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:24.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:24.355+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:24.679 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:24.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:25.406 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:25.399+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:25.654 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:25.647+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:26.386 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:26.379+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:26.676 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:26.667+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:27.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:27.335+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:27.656 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:27.647+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:28.382 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:28.375+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:28.674 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:28.667+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:29.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:29.359+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:29.652 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:29.643+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:30.417 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:30.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:30.670 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:30.663+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:31.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:31.415+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:31.676 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:31.667+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:32.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:32.431+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:32.704 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:32.695+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:33.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:33.443+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:33.658 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:33.651+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:34.503 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:34.495+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:34.683 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:34.675+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:35.545 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:35.535+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:35.730 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:35.723+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:36.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:36.535+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:36.710 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:36.703+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:37.557 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:37.547+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:37.753 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:37.743+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:38.581 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:38.571+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:38.763 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:38.755+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:39.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:39.551+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:39.771 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:39.763+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:40.512 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:40.503+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:40.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:40.731+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:41.511 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:41.503+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:41.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:41.727+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:42.561 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:42.551+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:42.725 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:42.715+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:43.602 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:43.591+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:43.722 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:43.715+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:44.570 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:44.563+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:44.685 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:44.675+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:45.568 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:45.559+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:45.643 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:45.635+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:46.617 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:46.607+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:46.693 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:46.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:47.655 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:47.647+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:47.675 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:47.667+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:48.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:48.695+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:48.708 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:48.699+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:49.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:49.699+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:49.742 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:49.735+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:50.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:50.659+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:50.765 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:50.755+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:51.641 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:51.631+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:51.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:51.771+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:52.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:52.639+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:52.791 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:52.783+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:53.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:53.687+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:53.769 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:53.759+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:54.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:54.723+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:54.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:54.727+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:55.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:55.727+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:55.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:55.731+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:56.714 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:56.707+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:56.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:56.775+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:57.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:57.723+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:57.823 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:57.815+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:58.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:58.727+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:58.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:58.843+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:12:59.752 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:12:59.743+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:12:59.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:12:59.843+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:00.764 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:00.755+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:00.858 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:00.847+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:01.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:01.771+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:01.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:01.867+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:02.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:02.731+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:02.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:02.847+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:03.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:03.703+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:03.834 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:03.823+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:04.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:04.739+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:04.878 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:04.867+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:05.789 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:05.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:05.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:05.919+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:06.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:06.783+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:06.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:06.911+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:07.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:07.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:07.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:07.899+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:08.789 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:08.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:08.872 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:08.863+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:09.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:09.783+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:09.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:09.887+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:10.744 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:10.735+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:10.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:10.927+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:11.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:11.707+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:11.974 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:11.967+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:12.764 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:12.755+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:12.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:12.959+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:13.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:13.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:14.019 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:14.011+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:14.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:14.759+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:15.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:15.035+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:15.762 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:15.751+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:16.068 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:16.059+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:16.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:16.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:17.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:17.043+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:17.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:17.807+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:18.086 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:18.079+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:18.863 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:18.855+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:19.039 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:19.031+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:19.880 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:19.871+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:20.044 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:20.035+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:20.840 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:20.831+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:21.077 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:21.067+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:21.828 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:21.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:22.097 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:22.087+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:22.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:22.783+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:23.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:23.055+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:23.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:23.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:24.082 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:24.075+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:24.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:24.783+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:25.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:25.071+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:25.789 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:25.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:26.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:26.119+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:26.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:26.747+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:27.109 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:27.099+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:27.743 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:27.735+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:28.094 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:28.087+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:28.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:28.727+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:29.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:29.095+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:29.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:29.707+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:30.129 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:30.119+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:30.690 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:30.683+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:31.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:31.083+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:31.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:31.695+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:32.087 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:32.079+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:32.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:32.695+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:33.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:33.095+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:33.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:33.667+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:34.076 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:34.067+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:34.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:34.655+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:35.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:35.039+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:35.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:35.623+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:36.097 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:36.087+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:36.586 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:36.575+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:37.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:37.131+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:37.581 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:37.571+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:38.113 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:38.103+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:38.602 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:38.595+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:39.102 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:39.095+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:39.558 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:39.547+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:40.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:40.047+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:40.591 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:40.583+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:41.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:41.039+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:41.563 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:41.555+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:42.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:42.035+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:42.608 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:42.599+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:42.998 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:42.991+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:43.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:43.619+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:43.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:43.959+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:44.588 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:44.579+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:44.985 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:44.975+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:45.573 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:45.563+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:45.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:45.951+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:46.536 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:46.527+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:47.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:46.991+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:47.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:47.527+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:48.027 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:48.019+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:48.569 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:48.559+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:49.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:49.051+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:49.588 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:49.579+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:50.068 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:50.059+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:50.575 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:50.567+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:51.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:51.047+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:51.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:51.551+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:52.039 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:52.031+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:52.579 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:52.571+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:53.078 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:53.067+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:53.551 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:53.543+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:54.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:54.111+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:54.551 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:54.543+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:55.156 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:55.147+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:55.565 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:55.555+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:56.145 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:56.135+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:56.616 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:56.607+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:57.151 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:57.142+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:57.637 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:57.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:58.149 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:58.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:58.612 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:58.598+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:13:59.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:13:59.150+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:13:59.600 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:13:59.590+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:00.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:00.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:00.592 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:00.582+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:01.150 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:01.138+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:01.575 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:01.566+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:02.157 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:02.146+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:02.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:02.518+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:03.150 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:03.138+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:03.555 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:03.546+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:04.185 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:04.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:04.523 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:04.514+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:05.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:05.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:05.546 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:05.538+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:06.231 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:06.222+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:06.581 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:06.570+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:07.258 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:07.250+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:07.592 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:07.582+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:08.218 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:08.206+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:08.617 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:08.606+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:09.177 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:09.166+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:09.663 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:09.650+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:10.145 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:10.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:10.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:10.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:11.124 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:11.110+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:11.664 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:11.650+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:12.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:12.114+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:12.659 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:12.650+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:13.107 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:13.098+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:13.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:13.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:14.105 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:14.094+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:14.727 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:14.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:15.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:15.082+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:15.761 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:15.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:16.056 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:16.046+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:16.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:16.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:17.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:17.014+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:17.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:17.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:17.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:17.970+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:18.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:18.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:18.951 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:18.942+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:19.765 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:19.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:19.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:19.954+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:20.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:20.738+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:20.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:20.914+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:21.752 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:21.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:21.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:21.966+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:22.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:22.774+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:23.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:22.998+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:23.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:23.814+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:23.992 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:23.982+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:24.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:24.794+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:24.950 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:24.942+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:25.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:25.842+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:25.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:25.930+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:26.889 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:26.878+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:26.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:26.958+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:27.927 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:27.914+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:27.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:27.982+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:28.914 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:28.906+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:29.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:29.006+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:29.948 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:29.938+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:29.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:29.970+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:30.940 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:30.930+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:31.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:31.006+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:31.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:31.978+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:31.992 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:31.982+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:32.954 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:32.946+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:33.038 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:33.030+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:33.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:33.906+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:34.020 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:34.010+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:34.909 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:34.898+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:34.975 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:34.966+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:35.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:35.874+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:35.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:35.922+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:36.844 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:36.830+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:36.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:36.882+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:37.867 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:37.858+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:37.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:37.902+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:38.912 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:38.902+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:38.924 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:38.914+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:39.896 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:39.886+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:39.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:39.946+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:40.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:40.910+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:40.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:40.934+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:41.881 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:41.870+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:41.921 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:41.910+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:42.901 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:42.890+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:42.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:42.922+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:43.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:43.862+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:43.960 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:43.950+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:44.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:44.814+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:45.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:44.998+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:45.869 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:45.858+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:46.021 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:46.010+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:46.912 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:46.902+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:47.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:47.030+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:47.891 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:47.882+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:48.036 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:48.026+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:48.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:48.838+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:49.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:49.030+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:49.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:49.814+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:50.049 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:50.038+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:50.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:50.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:51.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:51.046+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:51.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:51.826+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:52.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:52.062+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:52.821 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:52.810+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:53.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:53.086+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:53.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:53.838+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:54.068 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:54.058+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:54.857 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:54.846+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:55.096 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:55.086+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:55.865 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:55.854+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:56.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:56.054+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:56.914 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:56.906+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:57.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:57.046+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:57.877 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:57.866+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:58.102 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:58.094+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:58.897 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:58.886+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:14:59.111 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:14:59.102+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:14:59.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:14:59.874+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:00.110 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:00.098+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:00.926 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:00.918+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:01.108 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:01.098+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:01.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:01.910+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:02.152 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:02.142+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:02.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:02.906+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:03.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:03.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:03.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:03.898+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:04.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:04.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:04.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:04.882+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:05.226 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:05.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:05.939 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:05.930+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:06.263 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:06.254+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:06.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:06.938+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:07.257 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:07.246+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:07.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:07.982+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:08.235 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:08.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:08.961 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:08.950+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:09.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:09.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:09.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:09.966+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:10.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:10.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:10.939 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:10.930+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:11.197 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:11.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:11.980 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:11.970+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:12.213 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:12.202+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:12.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:12.938+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:13.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:13.210+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:13.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:13.954+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:14.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:14.182+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:14.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:14.938+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:15.201 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:15.190+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:15.975 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:15.966+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:16.204 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:16.194+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:17.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:17.002+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:17.160 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:17.150+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:18.009 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:17.998+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:18.204 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:18.194+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:19.056 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:19.046+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:19.167 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:19.150+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:20.097 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:20.086+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:20.148 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:20.138+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:21.099 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:21.090+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:21.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:21.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:22.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:22.046+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:22.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:22.130+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:23.046 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:23.038+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:23.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:23.106+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:24.042 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:24.034+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:24.074 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:24.066+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:25.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:25.030+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:25.090 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:25.082+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:26.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:26.078+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:26.097 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:26.086+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:27.056 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:27.046+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:27.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:27.074+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:28.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:28.002+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:28.038 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:28.030+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:29.014 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:29.002+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:29.055 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:29.046+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:30.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:30.018+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:30.095 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:30.086+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:31.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:31.029+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:31.139 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:31.125+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:32.025 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:32.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:32.181 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:32.169+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:33.014 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:33.001+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:33.193 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:33.181+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:33.980 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:33.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:34.200 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:34.189+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:35.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:34.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:35.186 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:35.173+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:35.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:35.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:36.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:36.185+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:36.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:36.981+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:37.154 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:37.141+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:38.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:38.025+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:38.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:38.109+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:39.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:39.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:39.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:39.065+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:39.985 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:39.977+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:40.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:40.045+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:40.974 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:40.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:41.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:41.009+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:42.010 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:42.001+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:42.067 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:42.061+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:43.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:43.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:43.089 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:43.081+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:44.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:44.025+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:44.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:44.037+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:45.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:45.005+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:45.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:45.065+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:46.048 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:46.041+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:46.064 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:46.057+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:47.027 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:47.021+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:47.032 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:47.025+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:47.995 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:47.989+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:48.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:47.993+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:48.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:48.973+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:49.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:49.001+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:49.960 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:49.953+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:49.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:49.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:50.922 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:50.913+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:50.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:50.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:51.896 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:51.889+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:51.922 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:51.917+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:52.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:52.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:52.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:52.925+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:53.894 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:53.885+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:53.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:53.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:54.920 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:54.913+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:54.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:54.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:55.937 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:55.929+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:55.973 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:55.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:56.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:56.885+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:56.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:56.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:57.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:57.893+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:57.986 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:57.977+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:58.924 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:58.917+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:58.987 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:58.981+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:15:59.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:15:59.965+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:15:59.984 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:15:59.977+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:01.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:01.005+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:01.031 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:01.025+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:01.991 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:01.985+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:02.008 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:02.001+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:03.019 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:03.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:03.045 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:03.037+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:03.983 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:03.977+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:04.005 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:03.997+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:04.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:04.973+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:05.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:04.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:05.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:05.985+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:06.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:06.009+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:07.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:06.997+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:07.066 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:07.057+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:08.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:08.009+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:08.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:08.093+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:09.025 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:09.017+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:09.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:09.137+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:10.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:10.001+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:10.152 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:10.145+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:11.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:10.997+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:11.105 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:11.097+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:12.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:12.009+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:12.074 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:12.065+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:12.981 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:12.973+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:13.115 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:13.109+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:13.984 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:13.977+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:14.082 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:14.073+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:15.007 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:15.001+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:15.122 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:15.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:15.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:15.961+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:16.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:16.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:16.946 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:16.941+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:17.149 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:17.141+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:17.909 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:17.901+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:18.150 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:18.145+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:18.960 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:18.953+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:19.150 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:19.145+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:19.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:19.985+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:20.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:20.113+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:20.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:20.989+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:21.073 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:21.065+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:21.983 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:21.977+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:22.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:22.109+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:23.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:23.009+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:23.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:23.133+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:23.981 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:23.973+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:24.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:24.085+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:24.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:24.949+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:25.124 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:25.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:25.960 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:25.953+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:26.106 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:26.097+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:26.933 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:26.925+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:27.061 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:27.053+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:27.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:27.925+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:28.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:28.085+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:28.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:28.949+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:29.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:29.081+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:29.926 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:29.917+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:30.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:30.065+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:30.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:30.885+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:31.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:31.033+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:31.854 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:31.845+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:32.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:32.025+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:32.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:32.825+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:33.027 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:33.021+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:33.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:33.785+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:34.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:34.025+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:34.744 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:34.737+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:35.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:35.025+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:35.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:35.785+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:36.074 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:36.065+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:36.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:36.785+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:37.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:37.089+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:37.748 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:37.741+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:38.060 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:38.053+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:38.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:38.701+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:39.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:39.089+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:39.708 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:39.701+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:40.082 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:40.073+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:40.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:40.749+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:41.080 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:41.073+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:41.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:41.749+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:42.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:42.121+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:42.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:42.761+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:43.114 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:43.109+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:43.765 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:43.757+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:44.102 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:44.093+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:44.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:44.729+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:45.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:45.065+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:45.692 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:45.685+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:46.122 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:46.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:46.720 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:46.713+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:47.114 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:47.109+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:47.689 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:47.681+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:48.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:48.065+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:48.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:48.721+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:49.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:49.077+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:49.740 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:49.733+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:50.066 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:50.057+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:50.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:50.753+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:51.049 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:51.041+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:51.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:51.753+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:52.010 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:52.001+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:52.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:52.765+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:53.025 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:53.017+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:53.740 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:53.733+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:54.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:54.029+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:54.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:54.729+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:55.005 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:54.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:55.728 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:55.721+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:55.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:55.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:56.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:56.769+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:56.933 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:56.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:57.800 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:57.793+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:57.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:57.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:58.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:58.749+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:16:58.981 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:16:58.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:16:59.736 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:16:59.729+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:00.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:00.021+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:00.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:00.749+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:01.046 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:01.037+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:01.734 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:01.724+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:02.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:02.024+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:02.694 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:02.684+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:03.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:03.072+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:03.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:03.688+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:04.036 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:04.028+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:04.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:04.648+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:04.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:04.980+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:05.612 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:05.604+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:05.988 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:05.980+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:06.619 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:06.612+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:06.951 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:06.944+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:07.646 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:07.640+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:07.937 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:07.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:08.664 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:08.656+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:08.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:08.924+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:09.638 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:09.632+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:09.946 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:09.940+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:10.623 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:10.616+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:10.918 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:10.908+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:11.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:11.596+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:11.900 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:11.892+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:12.639 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:12.632+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:12.871 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:12.864+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:13.662 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:13.652+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:13.864 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:13.856+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:14.696 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:14.688+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:14.820 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:14.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:15.739 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:15.732+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:15.791 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:15.784+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:16.714 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:16.708+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:16.812 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:16.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:17.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:17.696+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:17.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:17.844+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:18.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:18.716+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:18.833 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:18.824+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:19.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:19.740+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:19.814 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:19.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:20.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:20.700+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:20.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:20.832+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:21.709 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:21.700+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:21.866 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:21.856+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:22.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:22.692+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:22.820 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:22.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:23.685 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:23.676+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:23.773 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:23.764+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:24.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:24.660+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:24.766 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:24.760+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:25.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:25.660+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:25.721 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:25.712+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:26.672 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:26.664+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:26.714 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:26.704+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:27.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:27.640+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:27.708 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:27.700+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:28.604 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:28.596+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:28.729 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:28.720+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:29.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:29.548+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:29.770 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:29.764+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:30.603 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:30.596+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:30.748 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:30.740+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:31.595 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:31.588+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:31.757 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:31.748+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:32.588 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:32.580+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:32.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:32.732+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:33.624 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:33.616+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:33.766 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:33.756+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:34.641 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:34.632+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:34.809 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:34.800+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:35.663 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:35.656+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:35.839 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:35.832+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:36.709 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:36.700+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:36.862 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:36.852+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:37.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:37.708+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:37.859 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:37.852+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:38.699 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:38.692+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:38.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:38.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:39.746 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:39.736+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:39.920 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:39.912+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:40.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:40.716+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:40.880 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:40.872+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:41.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:41.760+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:41.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:41.908+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:42.765 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:42.756+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:42.890 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:42.884+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:43.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:43.728+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:43.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:43.868+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:44.709 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:44.700+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:44.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:44.876+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:45.733 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:45.724+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:45.871 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:45.864+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:46.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:46.708+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:46.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:46.828+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:47.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:47.688+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:47.830 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:47.820+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:48.702 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:48.692+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:48.847 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:48.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:49.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:49.708+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:49.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:49.796+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:50.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:50.708+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:50.814 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:50.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:51.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:51.692+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:51.787 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:51.780+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:52.742 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:52.732+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:52.782 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:52.776+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:53.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:53.768+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:53.802 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:53.792+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:54.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:54.796+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:54.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:54.844+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:55.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:55.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:55.901 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:55.892+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:56.854 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:56.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:56.947 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:56.940+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:57.865 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:57.856+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:57.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:57.908+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:58.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:58.904+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:58.954 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:58.948+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:17:59.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:17:59.884+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:17:59.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:17:59.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:00.927 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:00.920+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:00.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:00.940+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:01.882 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:01.872+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:01.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:01.912+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:02.889 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:02.880+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:02.911 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:02.904+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:03.879 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:03.872+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:03.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:03.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:04.878 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:04.868+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:04.938 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:04.928+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:05.897 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:05.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:05.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:05.900+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:06.899 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:06.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:06.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:06.912+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:07.864 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:07.856+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:07.935 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:07.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:08.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:08.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:08.961 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:08.952+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:09.867 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:09.860+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:09.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:09.924+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:10.879 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:10.872+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:10.941 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:10.932+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:11.903 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:11.896+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:11.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:11.908+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:12.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:12.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:12.901 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:12.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:13.912 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:13.904+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:13.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:13.936+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:14.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:14.892+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:14.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:14.920+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:15.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:15.884+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:15.969 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:15.960+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:16.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:16.912+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:16.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:16.960+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:17.935 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:17.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:17.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:17.928+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:18.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:18.884+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:18.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:18.968+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:19.869 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:19.860+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:19.985 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:19.976+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:20.872 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:20.864+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:20.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:20.940+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:21.848 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:21.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:21.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:21.908+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:22.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:22.796+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:22.933 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:22.924+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:23.786 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:23.780+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:23.929 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:23.920+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:24.834 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:24.828+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:24.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:24.908+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:25.844 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:25.836+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:25.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:25.908+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:26.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:26.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:26.876 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:26.868+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:27.857 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:27.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:27.863 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:27.856+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:28.828 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:28.820+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:28.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:28.900+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:29.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:29.807+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:29.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:29.951+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:30.832 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:30.823+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:30.984 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:30.975+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:31.821 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:31.811+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:32.023 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:32.015+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:32.837 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:32.827+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:33.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:33.059+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:33.888 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:33.879+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:34.047 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:34.035+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:34.892 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:34.883+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:35.078 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:35.071+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:35.890 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:35.879+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:36.116 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:36.107+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:36.939 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:36.931+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:37.140 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:37.131+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:37.967 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:37.959+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:38.183 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:38.175+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:38.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:38.923+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:39.184 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:39.175+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:39.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:39.955+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:40.193 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:40.183+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:40.977 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:40.967+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:41.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:41.167+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:41.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:41.971+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:42.211 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:42.203+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:42.973 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:42.963+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:43.205 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:43.195+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:44.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:43.991+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:44.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:44.199+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:44.969 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:44.959+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:45.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:45.179+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:45.986 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:45.975+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:46.182 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:46.171+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:46.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:46.983+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:47.161 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:47.151+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:48.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:48.019+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:48.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:48.111+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:49.069 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:49.059+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:49.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:49.063+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:50.055 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:50.047+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:50.101 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:50.091+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:51.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:51.015+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:51.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:51.119+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:52.040 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:52.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:52.109 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:52.099+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:52.992 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:52.983+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:53.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:53.111+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:54.009 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:53.999+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:54.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:54.111+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:54.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:54.971+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:55.096 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:55.087+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:55.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:55.951+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:56.056 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:56.047+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:56.992 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:56.983+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:57.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:57.059+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:57.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:57.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:58.023 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:58.015+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:58.933 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:58.923+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:18:59.044 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:18:59.035+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:18:59.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:18:59.899+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:00.012 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:00.003+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:00.929 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:00.919+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:01.008 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:00.999+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:01.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:01.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:02.010 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:01.999+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:02.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:02.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:03.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:03.023+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:03.920 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:03.911+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:04.069 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:04.059+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:04.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:04.907+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:05.052 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:05.043+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:05.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:05.935+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:06.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:06.079+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:06.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:06.899+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:07.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:07.095+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:07.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:07.899+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:08.086 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:08.075+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:08.939 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:08.931+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:09.123 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:09.115+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:09.911 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:09.903+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:10.149 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:10.139+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:10.938 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:10.927+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:11.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:11.179+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:11.986 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:11.975+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:12.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:12.203+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:12.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:12.935+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:13.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:13.155+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:13.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:13.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:14.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:14.175+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:14.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:14.943+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:15.165 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:15.155+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:15.946 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:15.935+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:16.217 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:16.207+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:16.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:16.963+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:17.221 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:17.211+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:18.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:18.007+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:18.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:18.223+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:18.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:18.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:19.243 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:19.235+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:20.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:20.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:20.240 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:20.231+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:20.993 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:20.983+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:21.227 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:21.219+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:22.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:22.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:22.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:22.203+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:23.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:23.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:23.166 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:23.155+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:24.078 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:24.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:24.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:24.159+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:25.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:25.107+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:25.136 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:25.127+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:26.142 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:26.131+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:26.165 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:26.155+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:27.145 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:27.135+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:27.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:27.171+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:28.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:28.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:28.208 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:28.199+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:29.089 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:29.079+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:29.163 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:29.155+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:30.081 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:30.071+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:30.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:30.179+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:31.121 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:31.111+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:31.199 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:31.191+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:32.116 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:32.107+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:32.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:32.155+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:33.165 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:33.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:33.204 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:33.195+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:34.138 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:34.127+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:34.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:34.187+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:35.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:35.119+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:35.218 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:35.207+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:36.100 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:36.091+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:36.223 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:36.211+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:37.058 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:37.047+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:37.249 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:37.239+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:38.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:38.003+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:38.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:38.251+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:39.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:38.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:39.256 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:39.247+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:39.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:39.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:40.235 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:40.227+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:40.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:40.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:41.243 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:41.235+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:41.969 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:41.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:42.227 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:42.215+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:42.980 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:42.971+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:43.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:43.267+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:44.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:43.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:44.258 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:44.247+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:44.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:44.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:45.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:45.227+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:45.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:45.963+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:46.278 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:46.267+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:46.986 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:46.975+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:47.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:47.315+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:48.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:48.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:48.278 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:48.267+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:49.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:49.063+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:49.240 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:49.231+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:50.071 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:50.063+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:50.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:50.271+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:51.100 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:51.091+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:51.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:51.267+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:52.093 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:52.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:52.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:52.303+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:53.141 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:53.131+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:53.339 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:53.331+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:54.131 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:54.123+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:54.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:54.283+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:55.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:55.075+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:55.268 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:55.259+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:56.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:56.119+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:56.298 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:56.286+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:57.080 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:57.070+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:57.324 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:57.314+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:58.097 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:58.086+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:58.307 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:58.298+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:19:59.095 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:19:59.082+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:19:59.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:19:59.326+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:00.098 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:00.086+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:00.349 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:00.338+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:01.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:01.058+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:01.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:01.290+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:02.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:02.106+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:02.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:02.338+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:03.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:03.062+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:03.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:03.342+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:04.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:04.082+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:04.327 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:04.318+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:05.103 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:05.090+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:05.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:05.362+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:06.107 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:06.098+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:06.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:06.322+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:07.062 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:07.050+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:07.322 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:07.310+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:08.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:08.054+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:08.316 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:08.298+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:09.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:09.006+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:09.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:09.350+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:10.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:10.030+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:10.345 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:10.334+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:11.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:11.006+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:11.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:11.370+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:12.008 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:11.998+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:12.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:12.394+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:12.976 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:12.966+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:13.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:13.430+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:13.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:13.946+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:14.455 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:14.446+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:14.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:14.978+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:15.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:15.458+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:16.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:16.018+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:16.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:16.470+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:16.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:16.982+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:17.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:17.426+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:17.961 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:17.950+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:18.449 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:18.438+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:18.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:18.938+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:19.434 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:19.422+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:19.956 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:19.946+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:20.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:20.426+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:20.913 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:20.902+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:21.431 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:21.422+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:21.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:21.942+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:22.391 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:22.382+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:22.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:22.906+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:23.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:23.426+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:23.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:23.934+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:24.449 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:24.438+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:24.983 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:24.974+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:25.481 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:25.470+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:26.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:25.990+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:26.505 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:26.494+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:26.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:26.982+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:27.517 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:27.506+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:27.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:27.970+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:28.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:28.474+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:29.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:29.006+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:29.515 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:29.502+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:30.058 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:30.046+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:30.553 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:30.542+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:31.083 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:31.074+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:31.572 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:31.562+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:32.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:32.094+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:32.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:32.586+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:33.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:33.074+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:33.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:33.606+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:34.096 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:34.086+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:34.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:34.606+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:35.135 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:35.122+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:35.655 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:35.642+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:36.094 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:36.082+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:36.636 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:36.626+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:37.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:37.090+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:37.649 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:37.638+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:38.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:38.074+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:38.611 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:38.602+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:39.064 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:39.054+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:39.612 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:39.602+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:40.093 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:40.082+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:40.613 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:40.602+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:41.143 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:41.130+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:41.630 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:41.618+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:42.183 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:42.174+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:42.661 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:42.650+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:43.216 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:43.206+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:43.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:43.606+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:44.245 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:44.234+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:44.591 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:44.582+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:45.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:45.210+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:45.570 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:45.558+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:46.199 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:46.190+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:46.582 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:46.570+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:47.226 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:47.214+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:47.588 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:47.578+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:48.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:48.262+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:48.554 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:48.542+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:49.319 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:49.306+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:49.554 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:49.542+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:50.340 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:50.330+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:50.559 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:50.550+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:51.320 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:51.310+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:51.578 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:51.566+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:52.299 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:52.286+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:52.547 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:52.538+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:53.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:53.334+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:53.574 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:53.562+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:54.321 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:54.310+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:54.625 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:54.614+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:55.326 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:55.314+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:55.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:55.594+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:56.302 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:56.290+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:56.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:56.554+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:57.350 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:57.338+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:57.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:57.594+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:58.396 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:58.386+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:58.598 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:58.586+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:20:59.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:20:59.430+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:20:59.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:20:59.578+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:00.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:00.414+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:00.620 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:00.610+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:01.385 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:01.374+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:01.669 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:01.658+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:02.351 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:02.338+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:02.668 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:02.658+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:03.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:03.350+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:03.703 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:03.694+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:04.349 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:04.338+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:04.713 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:04.702+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:05.342 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:05.330+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:05.694 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:05.682+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:06.339 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:06.330+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:06.693 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:06.682+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:07.318 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:07.306+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:07.696 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:07.686+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:08.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:08.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:08.729 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:08.718+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:09.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:09.290+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:09.778 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:09.766+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:10.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:10.334+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:10.747 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:10.738+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:11.390 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:11.378+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:11.732 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:11.722+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:12.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:12.402+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:12.685 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:12.674+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:13.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:13.382+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:13.654 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:13.642+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:14.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:14.374+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:14.623 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:14.614+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:15.406 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:15.394+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:15.668 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:15.658+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:16.393 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:16.382+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:16.702 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:16.690+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:17.418 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:17.406+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:17.744 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:17.734+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:18.431 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:18.422+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:18.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:18.766+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:19.399 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:19.386+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:19.828 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:19.814+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:20.404 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:20.386+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:20.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:20.814+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:21.416 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:21.406+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:21.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:21.837+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:22.399 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:22.385+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:22.900 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:22.885+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:23.450 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:23.437+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:23.896 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:23.885+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:24.471 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:24.457+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:24.901 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:24.889+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:25.492 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:25.481+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:25.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:25.929+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:26.511 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:26.501+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:26.901 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:26.889+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:27.503 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:27.489+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:27.907 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:27.897+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:28.538 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:28.525+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:28.927 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:28.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:29.532 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:29.521+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:29.973 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:29.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:30.524 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:30.513+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:31.008 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:30.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:31.525 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:31.517+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:32.048 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:32.037+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:32.527 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:32.517+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:33.090 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:33.081+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:33.553 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:33.545+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:34.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:34.049+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:34.584 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:34.577+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:35.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:35.073+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:35.538 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:35.529+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:36.122 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:36.113+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:36.505 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:36.497+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:37.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:37.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:37.493 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:37.485+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:38.207 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:38.201+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:38.472 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:38.465+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:39.185 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:39.177+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:39.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:39.453+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:40.200 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:40.193+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:40.448 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:40.441+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:41.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:41.185+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:41.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:41.409+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:42.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:42.173+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:42.461 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:42.453+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:43.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:43.125+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:43.442 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:43.433+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:44.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:44.113+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:44.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:44.449+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:45.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:45.069+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:45.473 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:45.465+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:46.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:46.077+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:46.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:46.433+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:47.124 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:47.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:47.423 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:47.413+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:48.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:48.149+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:48.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:48.429+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:49.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:49.133+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:49.438 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:49.429+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:50.110 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:50.101+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:50.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:50.413+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:51.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:51.137+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:51.374 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:51.365+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:52.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:52.177+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:52.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:52.365+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:53.232 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:53.225+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:53.388 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:53.381+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:54.199 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:54.189+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:54.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:54.337+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:55.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:55.189+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:55.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:55.385+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:56.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:56.169+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:56.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:56.381+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:57.216 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:57.209+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:57.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:57.385+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:58.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:58.233+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:58.350 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:58.341+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:21:59.221 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:21:59.213+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:21:59.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:21:59.385+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:00.272 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:00.265+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:00.360 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:00.353+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:01.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:01.273+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:01.389 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:01.381+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:02.235 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:02.229+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:02.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:02.421+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:03.286 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:03.277+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:03.469 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:03.461+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:04.338 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:04.329+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:04.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:04.457+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:05.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:05.297+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:05.493 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:05.485+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:06.321 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:06.313+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:06.476 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:06.469+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:07.328 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:07.321+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:07.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:07.501+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:08.362 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:08.353+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:08.460 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:08.453+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:09.326 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:09.317+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:09.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:09.449+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:10.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:10.293+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:10.446 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:10.437+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:11.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:11.273+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:11.456 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:11.449+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:12.293 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:12.285+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:12.482 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:12.473+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:13.286 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:13.277+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:13.456 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:13.449+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:14.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:14.321+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:14.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:14.465+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:15.284 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:15.277+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:15.431 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:15.421+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:16.261 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:16.253+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:16.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:16.377+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:17.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:17.261+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:17.388 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:17.381+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:18.260 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:18.253+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:18.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:18.397+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:19.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:19.253+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:19.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:19.413+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:20.272 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:20.265+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:20.427 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:20.417+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:21.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:21.269+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:21.419 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:21.409+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:22.316 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:22.309+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:22.461 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:22.453+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:23.290 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:23.281+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:23.491 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:23.485+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:24.269 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:24.261+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:24.448 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:24.441+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:25.300 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:25.293+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:25.481 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:25.473+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:26.337 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:26.329+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:26.497 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:26.489+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:27.339 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:27.329+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:27.502 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:27.493+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:28.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:28.321+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:28.476 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:28.469+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:29.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:29.329+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:29.450 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:29.441+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:30.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:30.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:30.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:30.465+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:31.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:31.341+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:31.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:31.445+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:32.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:32.389+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:32.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:32.405+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:33.408 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:33.401+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:33.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:33.413+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:34.386 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:34.377+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:34.427 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:34.417+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:35.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:35.373+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:35.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:35.377+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:36.337 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:36.329+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:36.361 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:36.353+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:37.289 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:37.281+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:37.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:37.381+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:38.335 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:38.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:38.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:38.361+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:39.327 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:39.317+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:39.400 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:39.393+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:40.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:40.365+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:40.395 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:40.385+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:41.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:41.321+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:41.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:41.349+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:42.310 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:42.301+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:42.320 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:42.313+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:43.282 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:43.273+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:43.289 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:43.281+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:44.291 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:44.285+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:44.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:44.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:45.243 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:45.233+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:45.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:45.329+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:46.273 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:46.264+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:46.316 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:46.308+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:47.268 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:47.260+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:47.308 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:47.300+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:48.245 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:48.236+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:48.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:48.340+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:49.234 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:49.224+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:49.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:49.348+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:50.212 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:50.204+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:50.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:50.376+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:51.257 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:51.248+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:51.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:51.368+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:52.218 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:52.208+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:52.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:52.392+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:53.232 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:53.224+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:53.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:53.348+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:54.200 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:54.192+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:54.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:54.340+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:55.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:55.156+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:55.358 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:55.348+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:56.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:56.140+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:56.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:56.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:57.174 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:57.164+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:57.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:57.364+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:58.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:58.184+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:58.354 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:58.344+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:22:59.176 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:22:59.168+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:22:59.404 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:22:59.396+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:00.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:00.168+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:00.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:00.384+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:01.132 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:01.124+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:01.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:01.392+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:02.092 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:02.084+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:02.431 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:02.420+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:03.126 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:03.116+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:03.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:03.376+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:04.170 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:04.160+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:04.367 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:04.360+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:05.222 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:05.212+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:05.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:05.348+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:06.232 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:06.224+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:06.387 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:06.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:07.194 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:07.184+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:07.342 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:07.332+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:08.224 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:08.216+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:08.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:08.368+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:09.217 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:09.208+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:09.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:09.340+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:10.225 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:10.216+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:10.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:10.348+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:11.246 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:11.236+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:11.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:11.308+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:12.278 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:12.268+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:12.288 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:12.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:13.292 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:13.284+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:13.307 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:13.296+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:14.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:14.268+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:14.338 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:14.328+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:15.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:15.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:15.323 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:15.316+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:16.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:16.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:16.353 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:16.344+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:17.275 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:17.264+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:17.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:17.336+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:18.239 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:18.228+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:18.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:18.380+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:19.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:19.184+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:19.371 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:19.360+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:20.202 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:20.192+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:20.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:20.372+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:21.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:21.168+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:21.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:21.412+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:22.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:22.148+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:22.458 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:22.448+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:23.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:23.196+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:23.460 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:23.452+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:24.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:24.228+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:24.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:24.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:25.225 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:25.216+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:25.502 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:25.492+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:26.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:26.180+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:26.479 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:26.468+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:27.153 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:27.144+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:27.506 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:27.496+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:28.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:28.196+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:28.506 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:28.496+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:29.228 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:29.220+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:29.506 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:29.496+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:30.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:30.232+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:30.460 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:30.452+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:31.205 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:31.196+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:31.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:31.428+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:32.209 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:32.200+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:32.406 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:32.396+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:33.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:33.160+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:33.385 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:33.376+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:34.133 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:34.124+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:34.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:34.428+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:35.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:35.144+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:35.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:35.392+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:36.134 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:36.124+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:36.443 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:36.436+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:37.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:37.104+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:37.396 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:37.388+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:38.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:38.084+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:38.374 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:38.364+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:39.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:39.108+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:39.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:39.356+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:40.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:40.080+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:40.320 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:40.312+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:41.101 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:41.092+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:41.286 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:41.276+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:42.151 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:42.140+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:42.323 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:42.316+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:43.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:43.120+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:43.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:43.320+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:44.169 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:44.160+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:44.363 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:44.352+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:45.169 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:45.160+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:45.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:45.336+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:46.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:46.200+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:46.371 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:46.364+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:47.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:47.220+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:47.341 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:47.332+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:48.183 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:48.172+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:48.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:48.348+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:49.169 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:49.160+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:49.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:49.376+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:50.185 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:50.176+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:50.377 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:50.368+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:51.214 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:51.204+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:51.366 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:51.356+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:52.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:52.220+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:52.382 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:52.372+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:53.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:53.256+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:53.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:53.384+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:54.241 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:54.232+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:54.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:54.384+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:55.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:55.244+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:55.431 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:55.420+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:56.266 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:56.256+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:56.472 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:56.464+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:57.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:57.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:57.511 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:57.500+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:58.322 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:58.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:58.482 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:58.472+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:23:59.297 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:23:59.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:23:59.495 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:23:59.488+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:00.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:00.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:00.523 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:00.512+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:01.308 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:01.300+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:01.573 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:01.564+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:02.278 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:02.268+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:02.609 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:02.600+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:03.265 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:03.256+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:03.643 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:03.632+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:04.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:04.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:04.660 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:04.652+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:05.248 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:05.236+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:05.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:05.664+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:06.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:06.256+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:06.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:06.660+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:07.304 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:07.296+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:07.622 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:07.612+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:08.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:08.252+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:08.619 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:08.608+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:09.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:09.283+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:09.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:09.659+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:10.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:10.243+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:10.630 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:10.619+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:11.265 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:11.255+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:11.655 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:11.643+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:12.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:12.271+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:12.625 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:12.615+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:13.274 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:13.263+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:13.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:13.619+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:14.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:14.231+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:14.623 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:14.611+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:15.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:15.267+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:15.618 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:15.607+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:16.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:16.263+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:16.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:16.619+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:17.294 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:17.283+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:17.645 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:17.635+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:18.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:18.307+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:18.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:18.659+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:19.335 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:19.323+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:19.678 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:19.667+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:20.368 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:20.359+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:20.636 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:20.627+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:21.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:21.339+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:21.671 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:21.659+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:22.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:22.319+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:22.695 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:22.683+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:23.368 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:23.359+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:23.678 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:23.667+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:24.379 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:24.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:24.658 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:24.647+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:25.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:25.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:25.641 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:25.631+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:26.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:26.363+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:26.687 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:26.675+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:27.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:27.395+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:27.642 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:27.631+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:28.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:28.427+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:28.637 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:28.627+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:29.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:29.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:29.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:29.667+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:30.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:30.355+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:30.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:30.663+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:31.378 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:31.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:31.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:31.707+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:32.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:32.363+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:32.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:32.731+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:33.409 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:33.399+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:33.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:33.735+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:34.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:34.427+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:34.706 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:34.695+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:35.468 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:35.459+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:35.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:35.659+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:36.427 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:36.415+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:36.658 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:36.647+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:37.448 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:37.439+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:37.618 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:37.607+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:38.412 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:38.403+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:38.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:38.619+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:39.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:39.363+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:39.596 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:39.587+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:40.398 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:40.387+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:40.557 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:40.547+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:41.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:41.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:41.602 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:41.591+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:42.386 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:42.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:42.618 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:42.607+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:43.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:43.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:43.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:43.635+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:44.409 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:44.399+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:44.648 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:44.639+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:45.369 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:45.359+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:45.672 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:45.663+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:46.405 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:46.395+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:46.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:46.647+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:47.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:47.431+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:47.620 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:47.611+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:48.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:48.471+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:48.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:48.635+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:49.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:49.515+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:49.645 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:49.635+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:50.565 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:50.555+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:50.597 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:50.587+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:51.568 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:51.559+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:51.619 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:51.607+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:52.551 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:52.539+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:52.643 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:52.631+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:53.517 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:53.507+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:53.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:53.595+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:54.488 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:54.479+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:54.596 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:54.587+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:55.509 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:55.499+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:55.591 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:55.579+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:56.509 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:56.499+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:56.547 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:56.535+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:57.505 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:57.495+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:57.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:57.499+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:58.490 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:58.479+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:58.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:58.507+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:24:59.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:24:59.463+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:24:59.533 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:24:59.523+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:00.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:00.463+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:00.493 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:00.483+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:01.429 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:01.419+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:01.458 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:01.447+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:02.399 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:02.387+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:02.503 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:02.491+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:03.413 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:03.403+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:03.460 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:03.447+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:04.415 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:04.403+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:04.432 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:04.423+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:05.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:05.363+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:05.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:05.463+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:06.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:06.379+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:06.443 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:06.431+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:07.420 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:07.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:07.446 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:07.435+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:08.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:08.395+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:08.456 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:08.447+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:09.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:09.363+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:09.437 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:09.427+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:10.344 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:10.335+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:10.471 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:10.459+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:11.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:11.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:11.434 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:11.423+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:12.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:12.379+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:12.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:12.455+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:13.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:13.351+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:13.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:13.455+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:14.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:14.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:14.476 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:14.467+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:15.358 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:15.347+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:15.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:15.419+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:16.341 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:16.331+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:16.451 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:16.439+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:17.391 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:17.379+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:17.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:17.451+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:18.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:18.387+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:18.499 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:18.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:19.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:19.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:19.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:19.443+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:20.426 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:20.415+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:20.427 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:20.415+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:21.393 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:21.383+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:21.409 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:21.399+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:22.417 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:22.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:22.457 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:22.447+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:23.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:23.359+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:23.465 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:23.455+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:24.353 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:24.343+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:24.426 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:24.415+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:25.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:25.367+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:25.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:25.379+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:26.398 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:26.387+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:26.402 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:26.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:27.383 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:27.371+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:27.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:27.383+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:28.355 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:28.343+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:28.357 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:28.347+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:29.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:29.335+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:29.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:29.363+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:30.303 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:30.291+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:30.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:30.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:31.310 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:31.298+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:31.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:31.422+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:32.312 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:32.302+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:32.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:32.394+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:33.307 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:33.294+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:33.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:33.390+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:34.306 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:34.294+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:34.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:34.382+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:35.338 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:35.326+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:35.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:35.362+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:36.365 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:36.354+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:36.368 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:36.358+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:37.408 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:37.394+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:37.412 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:37.402+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:38.403 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:38.390+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:38.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:38.430+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:39.386 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:39.374+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:39.398 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:39.386+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:40.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:40.346+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:40.387 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:40.374+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:41.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:41.334+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:41.358 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:41.346+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:42.306 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:42.294+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:42.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:42.310+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:43.270 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:43.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:43.359 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:43.346+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:44.252 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:44.242+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:44.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:44.390+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:45.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:45.222+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:45.453 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:45.438+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:46.205 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:46.194+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:46.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:46.402+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:47.231 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:47.218+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:47.415 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:47.402+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:48.244 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:48.234+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:48.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:48.358+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:49.264 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:49.254+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:49.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:49.378+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:50.273 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:50.262+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:50.387 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:50.374+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:51.262 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:51.250+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:51.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:51.346+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:52.284 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:52.274+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:52.355 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:52.342+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:53.247 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:53.234+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:53.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:53.338+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:54.271 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:54.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:54.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:54.354+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:55.314 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:55.302+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:55.355 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:55.342+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:56.327 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:56.314+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:56.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:56.334+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:57.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:57.294+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:57.313 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:57.302+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:58.292 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:58.282+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:58.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:58.342+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:25:59.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:25:59.282+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:25:59.342 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:25:59.330+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:00.289 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:00.278+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:00.301 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:00.290+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:01.283 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:01.270+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:01.290 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:01.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:02.239 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:02.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:02.309 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:02.298+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:03.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:03.190+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:03.308 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:03.294+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:04.206 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:04.194+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:04.304 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:04.294+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:05.215 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:05.202+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:05.324 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:05.314+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:06.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:06.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:06.282 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:06.270+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:07.232 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:07.222+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:07.244 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:07.234+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:08.209 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:08.198+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:08.211 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:08.198+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:09.179 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:09.166+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:09.191 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:09.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:10.150 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:10.138+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:10.171 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:10.158+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:11.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:11.102+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:11.165 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:11.154+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:12.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:12.082+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:12.173 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:12.162+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:13.094 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:13.082+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:13.135 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:13.122+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:14.050 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:14.038+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:14.138 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:14.126+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:15.025 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:15.014+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:15.185 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:15.174+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:15.984 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:15.974+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:16.184 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:16.174+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:17.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:16.990+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:17.238 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:17.222+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:17.995 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:17.982+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:18.276 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:18.266+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:19.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:18.990+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:19.231 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:19.218+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:19.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:19.962+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:20.222 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:20.210+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:20.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:20.946+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:21.271 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:21.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:21.985 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:21.974+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:22.266 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:22.254+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:22.996 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:22.986+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:23.256 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:23.242+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:24.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:24.002+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:24.236 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:24.226+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:24.984 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:24.974+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:25.229 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:25.218+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:26.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:26.010+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:26.231 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:26.218+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:27.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:27.006+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:27.211 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:27.198+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:28.048 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:28.038+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:28.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:28.166+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:29.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:29.058+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:29.186 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:29.174+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:30.029 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:30.018+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:30.186 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:30.174+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:31.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:31.006+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:31.179 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:31.166+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:32.044 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:32.034+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:32.163 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:32.150+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:33.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:33.082+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:33.179 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:33.166+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:34.108 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:34.094+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:34.136 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:34.126+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:35.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:35.058+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:35.172 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:35.158+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:36.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:36.062+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:36.182 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:36.170+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:37.032 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:37.018+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:37.182 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:37.170+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:38.014 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:38.002+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:38.217 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:38.206+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:38.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:38.962+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:39.201 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:39.190+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:39.952 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:39.938+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:40.249 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:40.238+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:40.960 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:40.950+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:41.238 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:41.226+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:41.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:41.914+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:42.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:42.198+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:42.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:42.942+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:43.250 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:43.238+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:43.923 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:43.910+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:44.292 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:44.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:44.909 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:44.898+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:45.290 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:45.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:45.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:45.918+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:46.247 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:46.234+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:46.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:46.882+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:47.233 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:47.222+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:47.888 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:47.878+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:48.271 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:48.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:48.898 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:48.886+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:49.276 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:49.262+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:49.881 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:49.870+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:50.326 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:50.314+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:50.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:50.902+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:51.331 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:51.318+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:51.882 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:51.870+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:52.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:52.366+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:52.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:52.897+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:53.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:53.389+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:53.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:53.881+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:54.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:54.349+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:54.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:54.837+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:55.347 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:55.333+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:55.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:55.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:56.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:56.365+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:56.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:56.845+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:57.352 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:57.341+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:57.870 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:57.857+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:58.352 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:58.341+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:58.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:58.905+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:26:59.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:26:59.365+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:26:59.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:26:59.905+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:00.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:00.357+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:00.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:00.933+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:01.390 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:01.381+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:01.983 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:01.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:02.390 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:02.381+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:02.998 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:02.989+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:03.409 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:03.401+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:04.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:04.033+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:04.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:04.429+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:05.031 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:05.021+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:05.410 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:05.401+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:06.074 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:06.065+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:06.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:06.401+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:07.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:07.081+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:07.372 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:07.361+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:08.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:08.037+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:08.415 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:08.405+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:09.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:08.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:09.413 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:09.405+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:09.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:09.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:10.427 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:10.417+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:10.920 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:10.909+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:11.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:11.413+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:11.962 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:11.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:12.382 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:12.373+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:12.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:12.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:13.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:13.365+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:13.896 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:13.889+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:14.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:14.329+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:14.921 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:14.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:15.365 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:15.357+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:15.911 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:15.901+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:16.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:16.369+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:16.922 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:16.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:17.358 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:17.349+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:17.891 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:17.881+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:18.331 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:18.321+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:18.927 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:18.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:19.323 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:19.313+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:19.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:19.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:20.283 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:20.273+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:20.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:20.929+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:21.309 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:21.301+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:21.922 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:21.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:22.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:22.337+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:22.928 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:22.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:23.320 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:23.313+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:23.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:23.885+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:24.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:24.337+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:24.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:24.885+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:25.329 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:25.321+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:25.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:25.845+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:26.358 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:26.349+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:26.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:26.809+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:27.322 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:27.313+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:27.777 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:27.769+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:28.301 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:28.293+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:28.738 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:28.729+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:29.327 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:29.317+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:29.716 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:29.709+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:30.374 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:30.365+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:30.747 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:30.737+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:31.397 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:31.389+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:31.729 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:31.721+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:32.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:32.357+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:32.704 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:32.697+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:33.316 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:33.309+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:33.725 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:33.717+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:34.347 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:34.337+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:34.772 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:34.761+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:35.309 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:35.301+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:35.780 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:35.769+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:36.297 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:36.289+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:36.754 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:36.745+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:37.340 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:37.329+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:37.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:37.729+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:38.319 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:38.309+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:38.750 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:38.741+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:39.332 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:39.321+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:39.751 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:39.741+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:40.312 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:40.305+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:40.758 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:40.749+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:41.348 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:41.341+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:41.789 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:41.781+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:42.394 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:42.385+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:42.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:42.797+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:43.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:43.337+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:43.802 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:43.793+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:44.304 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:44.297+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:44.798 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:44.789+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:45.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:45.313+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:45.783 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:45.773+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:46.318 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:46.309+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:46.769 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:46.761+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:47.291 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:47.281+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:47.787 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:47.777+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:48.282 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:48.273+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:48.789 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:48.781+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:49.323 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:49.313+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:49.798 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:49.789+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:50.279 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:50.269+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:50.773 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:50.765+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:51.318 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:51.309+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:51.778 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:51.769+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:52.327 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:52.317+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:52.748 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:52.741+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:53.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:53.353+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:53.772 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:53.761+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:54.410 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:54.401+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:54.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:54.805+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:55.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:55.353+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:55.842 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:55.833+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:56.360 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:56.349+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:56.872 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:56.861+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:57.397 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:57.389+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:57.838 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:57.829+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:58.433 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:58.425+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:58.881 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:58.873+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:27:59.399 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:27:59.389+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:27:59.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:27:59.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:00.437 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:00.429+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:00.899 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:00.889+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:01.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:01.397+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:01.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:01.937+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:02.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:02.349+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:02.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:02.909+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:03.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:03.377+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:03.920 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:03.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:04.435 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:04.425+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:04.907 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:04.897+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:05.427 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:05.417+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:05.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:05.949+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:06.462 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:06.453+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:06.920 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:06.909+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:07.450 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:07.441+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:07.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:07.873+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:08.444 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:08.433+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:08.867 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:08.857+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:09.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:09.421+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:09.823 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:09.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:10.438 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:10.429+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:10.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:10.809+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:11.443 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:11.433+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:11.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:11.777+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:12.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:12.465+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:12.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:12.785+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:13.490 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:13.481+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:13.751 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:13.741+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:14.506 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:14.496+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:14.728 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:14.716+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:15.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:15.532+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:15.722 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:15.712+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:16.573 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:16.564+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:16.748 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:16.736+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:17.538 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:17.528+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:17.721 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:17.712+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:18.582 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:18.572+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:18.760 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:18.748+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:19.597 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:19.588+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:19.718 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:19.708+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:20.561 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:20.552+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:20.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:20.696+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:21.522 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:21.512+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:21.742 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:21.732+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:22.543 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:22.532+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:22.758 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:22.748+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:23.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:23.548+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:23.727 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:23.716+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:24.578 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:24.568+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:24.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:24.728+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:25.592 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:25.580+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:25.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:25.736+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:26.612 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:26.600+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:26.722 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:26.712+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:27.633 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:27.624+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:27.702 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:27.692+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:28.607 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:28.596+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:28.660 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:28.648+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:29.646 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:29.636+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:29.679 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:29.668+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:30.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:30.644+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:30.728 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:30.720+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:31.652 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:31.644+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:31.764 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:31.756+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:32.620 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:32.612+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:32.800 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:32.788+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:33.629 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:33.620+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:33.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:33.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:34.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:34.616+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:34.858 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:34.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:35.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:35.656+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:35.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:35.816+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:36.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:36.692+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:36.860 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:36.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:37.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:37.744+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:37.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:37.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:38.709 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:38.700+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:38.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:38.844+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:39.754 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:39.744+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:39.869 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:39.860+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:40.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:40.792+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:40.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:40.872+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:41.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:41.836+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:41.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:41.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:42.845 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:42.836+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:42.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:42.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:43.882 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:43.872+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:43.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:43.956+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:44.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:44.856+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:44.933 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:44.924+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:45.828 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:45.816+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:45.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:45.904+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:46.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:46.780+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:46.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:46.936+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:47.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:47.768+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:47.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:47.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:48.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:48.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:48.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:48.896+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:49.754 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:49.744+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:49.909 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:49.900+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:50.762 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:50.752+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:50.882 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:50.872+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:51.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:51.792+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:51.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:51.900+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:52.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:52.800+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:52.865 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:52.856+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:53.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:53.792+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:53.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:53.844+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:54.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:54.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:54.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:54.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:55.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:55.788+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:55.844 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:55.832+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:56.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:56.812+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:56.859 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:56.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:57.828 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:57.816+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:57.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:57.828+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:58.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:58.780+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:28:58.828 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:58.816+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:59.800 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:28:59.788+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:28:59.800 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:28:59.788+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:00.765 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:00.756+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:00.800 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:00.788+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:01.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:01.740+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:01.829 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:01.820+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:02.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:02.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:02.806 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:02.796+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:03.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:03.752+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:03.777 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:03.768+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:04.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:04.792+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:04.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:04.800+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:05.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:05.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:05.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:05.808+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:06.792 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:06.780+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:06.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:06.812+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:07.804 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:07.792+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:07.857 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:07.848+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:08.814 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:08.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:08.838 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:08.828+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:09.768 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:09.756+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:09.866 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:09.856+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:10.723 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:10.712+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:10.899 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:10.888+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:11.756 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:11.744+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:11.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:11.872+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:12.720 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:12.708+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:12.850 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:12.840+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:13.699 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:13.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:13.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:13.820+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:14.685 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:14.676+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:14.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:14.796+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:15.658 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:15.648+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:15.839 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:15.828+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:16.684 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:16.672+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:16.882 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:16.872+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:17.718 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:17.708+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:17.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:17.884+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:18.742 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:18.732+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:18.922 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:18.912+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:19.695 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:19.684+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:19.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:19.868+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:20.713 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:20.704+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:20.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:20.896+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:21.745 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:21.736+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:21.905 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:21.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:22.709 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:22.700+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:22.939 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:22.928+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:23.691 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:23.680+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:23.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:23.976+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:24.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:24.676+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:24.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:24.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:25.648 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:25.636+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:26.009 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:26.000+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:26.644 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:26.632+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:27.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:26.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:27.689 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:27.676+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:27.971 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:27.960+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:28.720 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:28.708+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:28.933 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:28.924+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:29.725 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:29.716+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:29.922 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:29.912+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:30.732 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:30.720+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:30.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:30.872+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:31.716 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:31.704+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:31.867 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:31.856+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:32.756 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:32.744+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:32.867 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:32.856+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:33.718 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:33.708+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:33.904 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:33.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:34.684 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:34.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:34.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:34.919+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:35.677 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:35.663+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:35.922 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:35.911+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:36.641 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:36.631+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:36.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:36.943+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:37.614 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:37.603+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:37.949 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:37.939+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:38.597 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:38.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:38.922 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:38.911+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:39.623 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:39.611+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:39.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:39.883+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:40.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:40.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:40.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:40.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:41.563 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:41.551+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:41.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:41.807+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:42.585 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:42.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:42.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:42.799+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:43.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:43.555+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:43.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:43.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:44.562 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:44.551+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:44.800 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:44.787+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:45.565 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:45.555+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:45.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:45.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:46.542 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:46.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:46.839 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:46.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:47.509 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:47.499+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:47.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:47.859+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:48.466 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:48.455+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:48.913 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:48.903+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:49.511 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:49.499+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:49.912 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:49.899+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:50.464 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:50.451+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:50.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:50.923+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:51.438 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:51.427+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:51.894 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:51.883+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:52.445 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:52.435+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:52.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:52.839+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:53.410 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:53.399+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:53.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:53.807+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:54.399 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:54.387+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:54.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:54.767+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:55.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:55.387+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:55.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:55.783+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:56.420 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:56.407+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:56.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:56.763+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:57.399 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:57.387+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:57.742 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:57.731+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:58.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:58.363+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:58.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:58.747+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:29:59.389 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:29:59.379+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:29:59.805 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:29:59.791+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:00.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:00.395+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:00.789 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:00.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:01.366 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:01.355+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:01.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:01.755+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:02.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:02.395+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:02.768 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:02.755+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:03.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:03.371+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:03.753 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:03.743+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:04.418 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:04.407+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:04.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:04.747+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:05.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:05.383+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:05.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:05.719+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:06.425 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:06.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:06.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:06.755+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:07.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:07.395+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:07.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:07.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:08.430 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:08.419+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:08.806 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:08.795+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:09.446 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:09.435+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:09.853 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:09.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:10.410 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:10.399+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:10.887 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:10.875+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:11.429 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:11.419+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:11.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:11.903+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:12.473 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:12.463+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:12.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:12.879+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:13.452 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:13.439+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:13.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:13.835+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:14.440 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:14.427+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:14.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:14.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:15.465 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:15.455+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:15.857 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:15.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:16.458 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:16.447+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:16.843 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:16.831+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:17.456 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:17.443+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:17.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:17.831+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:18.419 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:18.407+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:18.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:18.831+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:19.466 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:19.455+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:19.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:19.839+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:20.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:20.419+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:20.829 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:20.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:21.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:21.423+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:21.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:21.791+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:22.442 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:22.431+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:22.850 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:22.839+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:23.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:23.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:23.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:23.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:24.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:24.371+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:24.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:24.799+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:25.392 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:25.379+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:25.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:25.783+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:26.416 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:26.403+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:26.753 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:26.743+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:27.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:27.383+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:27.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:27.703+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:28.396 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:28.383+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:28.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:28.723+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:29.447 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:29.435+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:29.720 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:29.707+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:30.477 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:30.463+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:30.720 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:30.707+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:31.439 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:31.427+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:31.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:31.707+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:32.462 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:32.451+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:32.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:32.739+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:33.484 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:33.471+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:33.765 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:33.755+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:34.469 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:34.455+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:34.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:34.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:35.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:35.475+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:35.805 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:35.791+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:36.530 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:36.519+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:36.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:36.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:37.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:37.503+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:37.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:37.735+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:38.533 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:38.523+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:38.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:38.703+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:39.508 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:39.495+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:39.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:39.743+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:40.519 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:40.507+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:40.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:40.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:41.543 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:41.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:41.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:41.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:42.594 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:42.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:42.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:42.859+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:43.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:43.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:43.888 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:43.875+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:44.638 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:44.627+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:44.865 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:44.855+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:45.623 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:45.611+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:45.838 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:45.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:46.664 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:46.651+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:46.838 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:46.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:47.667 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:47.655+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:47.806 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:47.795+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:48.665 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:48.655+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:48.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:48.783+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:49.710 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:49.699+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:49.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:49.787+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:50.753 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:50.739+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:50.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:50.795+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:51.736 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:51.723+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:51.854 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:51.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:52.786 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:52.775+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:52.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:52.799+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:53.738 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:53.727+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:53.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:53.823+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:54.696 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:54.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:54.874 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:54.863+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:55.671 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:55.658+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:55.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:55.822+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:56.668 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:56.654+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:56.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:56.838+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:57.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:57.614+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:57.838 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:57.826+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:58.664 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:58.650+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:58.876 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:58.862+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:30:59.644 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:30:59.630+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:30:59.850 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:30:59.838+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:00.662 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:00.650+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:00.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:00.802+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:01.660 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:01.646+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:01.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:01.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:02.711 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:02.698+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:02.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:02.770+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:03.674 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:03.662+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:03.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:03.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:04.705 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:04.694+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:04.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:04.766+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:05.754 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:05.742+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:05.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:05.790+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:06.764 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:06.750+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:06.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:06.818+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:07.767 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:07.754+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:07.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:07.858+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:08.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:08.734+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:08.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:08.902+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:09.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:09.726+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:09.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:09.866+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:10.734 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:10.722+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:10.929 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:10.914+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:11.766 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:11.754+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:11.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:11.882+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:12.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:12.734+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:12.853 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:12.842+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:13.727 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:13.714+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:13.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:13.826+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:14.737 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:14.722+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:14.802 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:14.790+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:15.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:15.738+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:15.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:15.814+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:16.714 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:16.702+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:16.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:16.858+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:17.694 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:17.682+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:17.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:17.902+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:18.696 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:18.682+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:18.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:18.878+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:19.671 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:19.658+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:19.904 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:19.890+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:20.655 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:20.642+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:20.857 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:20.846+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:21.612 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:21.598+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:21.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:21.830+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:22.598 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:22.586+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:22.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:22.802+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:23.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:23.578+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:23.775 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:23.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:24.551 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:24.538+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:24.762 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:24.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:25.556 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:25.542+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:25.732 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:25.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:26.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:26.554+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:26.732 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:26.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:27.572 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:27.558+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:27.743 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:27.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:28.560 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:28.546+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:28.725 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:28.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:29.606 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:29.594+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:29.681 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:29.666+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:30.641 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:30.626+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:30.692 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:30.678+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:31.666 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:31.654+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:31.732 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:31.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:32.683 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:32.670+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:32.775 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:32.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:33.711 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:33.698+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:33.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:33.810+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:34.695 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:34.682+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:34.859 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:34.846+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:35.650 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:35.638+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:35.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:35.810+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:36.701 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:36.690+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:36.863 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:36.850+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:37.726 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:37.714+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:37.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:37.834+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:38.776 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:38.762+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:38.879 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:38.866+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:39.740 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:39.726+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:39.895 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:39.882+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:40.724 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:40.710+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:40.940 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:40.926+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:41.712 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:41.698+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:41.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:41.922+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:42.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:42.674+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:42.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:42.958+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:43.644 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:43.630+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:44.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:43.994+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:44.663 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:44.650+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:45.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:45.006+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:45.640 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:45.626+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:46.010 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:45.998+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:46.642 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:46.630+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:47.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:46.986+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:47.693 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:47.682+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:47.994 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:47.982+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:48.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:48.722+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:49.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:49.030+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:49.754 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:49.742+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:50.026 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:50.014+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:50.787 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:50.774+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:50.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:50.970+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:51.809 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:51.794+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:52.005 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:51.994+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:52.786 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:52.774+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:53.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:52.990+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:53.789 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:53.774+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:53.992 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:53.978+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:54.743 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:54.730+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:54.978 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:54.966+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:55.719 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:55.706+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:55.931 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:55.918+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:56.740 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:56.726+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:56.943 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:56.930+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:57.771 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:57.758+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:57.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:57.950+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:58.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:58.778+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:58.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:58.982+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:31:59.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:31:59.798+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:31:59.998 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:31:59.986+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:00.801 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:00.790+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:01.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:00.990+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:01.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:01.822+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:01.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:01.942+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:02.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:02.782+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:02.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:02.918+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:03.776 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:03.762+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:03.978 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:03.966+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:04.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:04.798+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:04.993 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:04.978+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:05.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:05.822+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:06.028 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:06.014+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:06.797 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:06.782+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:07.058 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:07.046+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:07.792 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:07.778+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:08.048 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:08.034+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:08.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:08.802+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:09.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:09.006+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:09.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:09.770+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:09.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:09.986+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:10.756 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:10.742+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:10.958 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:10.946+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:11.798 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:11.786+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:11.925 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:11.910+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:12.771 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:12.758+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:12.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:12.886+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:13.775 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:13.762+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:13.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:13.878+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:14.823 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:14.810+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:14.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:14.834+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:15.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:15.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:15.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:15.869+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:16.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:16.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:16.841 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:16.825+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:17.880 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:17.865+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:17.885 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:17.869+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:18.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:18.861+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:18.895 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:18.881+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:19.886 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:19.873+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:19.923 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:19.909+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:20.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:20.877+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:20.906 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:20.893+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:21.873 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:21.857+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:21.887 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:21.873+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:22.879 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:22.865+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:22.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:22.873+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:23.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:23.837+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:23.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:23.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:24.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:24.809+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:24.939 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:24.929+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:25.800 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:25.789+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:25.923 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:25.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:26.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:26.769+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:26.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:26.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:27.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:27.773+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:27.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:27.885+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:28.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:28.785+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:28.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:28.885+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:29.833 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:29.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:29.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:29.885+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:30.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:30.781+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:30.887 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:30.877+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:31.842 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:31.833+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:31.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:31.905+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:32.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:32.825+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:32.911 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:32.901+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:33.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:33.793+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:33.922 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:33.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:34.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:34.753+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:34.899 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:34.889+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:35.787 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:35.777+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:35.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:35.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:36.805 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:36.793+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:36.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:36.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:37.833 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:37.821+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:37.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:37.837+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:38.832 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:38.821+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:38.845 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:38.833+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:39.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:39.825+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:39.882 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:39.873+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:40.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:40.781+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:40.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:40.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:41.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:41.741+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:41.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:41.885+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:42.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:42.777+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:42.847 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:42.837+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:43.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:43.781+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:43.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:43.793+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:44.834 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:44.825+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:44.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:44.825+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:45.879 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:45.869+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:45.880 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:45.869+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:46.850 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:46.841+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:46.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:46.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:47.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:47.857+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:47.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:47.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:48.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:48.857+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:48.927 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:48.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:49.909 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:49.897+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:49.936 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:49.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:50.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:50.905+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:50.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:50.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:51.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:51.921+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:51.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:51.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:52.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:52.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:52.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:52.937+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:53.877 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:53.865+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:53.922 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:53.913+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:54.879 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:54.869+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:54.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:54.881+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:55.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:55.901+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:55.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:55.921+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:56.935 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:56.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:56.952 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:56.941+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:57.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:57.937+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:57.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:57.977+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:32:58.983 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:32:58.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:32:59.008 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:32:58.997+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:00.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:00.005+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:00.026 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:00.017+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:00.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:00.985+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:01.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:01.049+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:02.033 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:02.021+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:02.046 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:02.037+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:03.007 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:02.997+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:03.066 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:03.057+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:03.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:03.977+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:04.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:04.089+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:04.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:04.945+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:05.080 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:05.069+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:05.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:05.953+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:06.049 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:06.037+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:06.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:06.965+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:07.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:07.077+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:07.942 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:07.933+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:08.086 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:08.077+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:08.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:08.909+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:09.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:09.093+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:09.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:09.957+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:10.080 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:10.069+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:11.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:11.001+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:11.119 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:11.109+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:12.059 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:12.049+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:12.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:12.089+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:13.056 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:13.045+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:13.086 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:13.077+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:14.032 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:14.021+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:14.136 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:14.125+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:15.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:14.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:15.089 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:15.077+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:16.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:16.009+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:16.067 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:16.057+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:17.050 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:17.041+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:17.093 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:17.081+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:18.004 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:17.993+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:18.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:18.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:18.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:18.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:19.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:19.109+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:19.984 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:19.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:20.137 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:20.125+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:21.023 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:21.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:21.094 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:21.085+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:22.003 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:21.993+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:22.046 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:22.037+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:23.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:22.993+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:23.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:23.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:23.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:23.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:24.021 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:24.009+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:24.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:24.921+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:25.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:25.061+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:25.895 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:25.885+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:26.031 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:26.021+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:26.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:26.845+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:27.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:26.989+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:27.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:27.861+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:27.987 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:27.977+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:28.885 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:28.873+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:28.961 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:28.949+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:29.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:29.905+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:29.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:29.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:30.951 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:30.941+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:30.977 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:30.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:31.949 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:31.937+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:31.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:31.949+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:32.926 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:32.917+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:32.927 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:32.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:33.906 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:33.897+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:33.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:33.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:34.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:34.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:34.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:34.964+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:35.928 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:35.916+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:35.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:35.940+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:36.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:36.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:36.980 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:36.968+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:37.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:37.916+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:38.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:38.016+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:38.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:38.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:39.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:39.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:39.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:39.940+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:40.083 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:40.072+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:41.004 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:40.992+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:41.128 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:41.116+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:42.032 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:42.020+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:42.161 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:42.148+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:43.019 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:43.008+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:43.181 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:43.168+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:44.029 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:44.016+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:44.140 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:44.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:45.031 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:45.020+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:45.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:45.176+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:46.063 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:46.052+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:46.237 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:46.224+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:47.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:47.004+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:47.234 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:47.224+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:48.048 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:48.036+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:48.205 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:48.192+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:49.037 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:49.024+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:49.157 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:49.144+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:49.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:49.980+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:50.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:50.140+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:51.004 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:50.992+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:51.200 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:51.188+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:52.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:51.996+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:52.179 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:52.168+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:53.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:53.012+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:53.213 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:53.200+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:54.066 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:54.056+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:54.245 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:54.232+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:55.046 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:55.032+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:55.219 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:55.208+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:56.052 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:56.040+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:56.174 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:56.160+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:57.015 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:57.004+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:57.163 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:57.152+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:57.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:57.956+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:58.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:58.116+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:58.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:58.936+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:33:59.147 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:33:59.136+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:33:59.991 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:33:59.980+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:00.100 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:00.088+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:00.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:00.936+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:01.077 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:01.064+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:01.971 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:01.960+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:02.042 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:02.028+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:03.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:03.004+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:03.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:03.008+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:03.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:03.968+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:04.059 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:04.048+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:05.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:05.004+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:05.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:05.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:05.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:05.984+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:06.040 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:06.028+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:06.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:06.936+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:06.995 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:06.984+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:07.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:07.904+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:08.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:07.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:08.886 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:08.876+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:09.047 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:09.036+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:09.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:09.916+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:10.075 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:10.064+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:10.936 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:10.924+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:11.099 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:11.088+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:11.961 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:11.948+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:12.140 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:12.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:12.987 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:12.976+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:13.107 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:13.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:13.995 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:13.984+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:14.157 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:14.144+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:14.961 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:14.948+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:15.123 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:15.112+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:15.942 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:15.932+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:16.143 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:16.132+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:16.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:16.944+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:17.183 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:17.172+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:17.922 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:17.912+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:18.167 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:18.152+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:18.902 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:18.892+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:19.215 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:19.204+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:19.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:19.864+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:20.194 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:20.180+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:20.859 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:20.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:21.163 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:21.152+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:21.859 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:21.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:22.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:22.184+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:22.870 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:22.860+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:23.224 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:23.212+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:23.888 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:23.876+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:24.271 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:24.260+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:24.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:24.904+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:25.298 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:25.284+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:25.892 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:25.880+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:26.291 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:26.280+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:26.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:26.932+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:27.287 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:27.276+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:27.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:27.896+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:28.318 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:28.308+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:28.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:28.916+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:29.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:29.324+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:29.950 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:29.940+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:30.363 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:30.352+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:30.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:30.940+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:31.340 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:31.328+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:31.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:31.916+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:32.324 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:32.312+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:32.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:32.896+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:33.350 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:33.336+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:33.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:33.932+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:34.312 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:34.300+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:34.918 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:34.908+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:35.306 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:35.296+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:35.890 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:35.880+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:36.352 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:36.340+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:36.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:36.872+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:37.321 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:37.308+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:37.885 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:37.872+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:38.314 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:38.304+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:38.936 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:38.924+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:39.289 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:39.276+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:39.985 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:39.972+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:40.314 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:40.300+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:40.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:40.960+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:41.314 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:41.304+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:41.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:41.984+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:42.289 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:42.276+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:43.048 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:43.036+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:43.252 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:43.240+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:44.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:44.016+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:44.263 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:44.252+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:45.037 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:45.024+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:45.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:45.276+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:46.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:45.988+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:46.290 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:46.276+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:47.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:47.000+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:47.262 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:47.248+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:48.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:48.016+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:48.257 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:48.244+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:49.023 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:49.012+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:49.271 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:49.260+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:50.066 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:50.052+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:50.232 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:50.220+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:51.044 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:51.032+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:51.274 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:51.264+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:52.076 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:52.064+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:52.321 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:52.308+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:53.051 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:53.040+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:53.291 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:53.280+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:54.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:54.072+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:54.342 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:54.327+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:55.110 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:55.099+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:55.334 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:55.323+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:56.149 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:56.135+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:56.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:56.287+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:57.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:57.171+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:57.351 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:57.339+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:58.157 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:58.143+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:58.322 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:58.311+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:34:59.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:34:59.143+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:34:59.316 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:34:59.303+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:00.165 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:00.151+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:00.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:00.351+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:01.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:01.127+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:01.332 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:01.319+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:02.137 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:02.123+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:02.284 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:02.271+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:03.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:03.079+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:03.299 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:03.287+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:04.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:04.075+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:04.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:04.287+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:05.051 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:05.039+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:05.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:05.275+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:06.008 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:05.995+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:06.304 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:06.291+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:07.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:07.027+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:07.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:07.275+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:08.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:08.027+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:08.293 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:08.279+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:09.084 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:09.067+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:09.322 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:09.307+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:10.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:10.083+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:10.314 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:10.303+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:11.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:11.071+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:11.332 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:11.319+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:12.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:12.031+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:12.322 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:12.307+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:13.066 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:13.051+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:13.347 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:13.335+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:14.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:14.023+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:14.333 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:14.319+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:15.048 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:15.035+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:15.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:15.363+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:16.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:16.083+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:16.382 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:16.371+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:17.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:17.107+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:17.416 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:17.403+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:18.111 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:18.099+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:18.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:18.363+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:19.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:19.071+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:19.377 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:19.363+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:20.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:20.115+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:20.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:20.343+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:21.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:21.083+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:21.349 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:21.335+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:22.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:22.051+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:22.317 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:22.303+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:23.094 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:23.079+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:23.312 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:23.299+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:24.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:24.035+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:24.267 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:24.255+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:25.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:25.011+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:25.264 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:25.251+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:26.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:26.003+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:26.274 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:26.259+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:27.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:27.023+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:27.299 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:27.287+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:28.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:28.027+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:28.342 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:28.331+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:28.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:28.983+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:29.343 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:29.331+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:29.960 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:29.947+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:30.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:30.379+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:30.913 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:30.899+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:31.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:31.331+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:31.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:31.939+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:32.367 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:32.355+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:32.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:32.963+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:33.374 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:33.363+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:34.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:34.003+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:34.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:34.347+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:34.995 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:34.983+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:35.332 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:35.319+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:35.986 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:35.975+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:36.292 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:36.279+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:37.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:37.007+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:37.318 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:37.307+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:38.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:38.059+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:38.338 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:38.327+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:39.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:39.031+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:39.347 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:39.335+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:40.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:40.075+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:40.332 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:40.319+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:41.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:41.031+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:41.341 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:41.327+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:42.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:42.059+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:42.354 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:42.343+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:43.025 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:43.011+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:43.399 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:43.387+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:44.052 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:44.039+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:44.451 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:44.439+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:45.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:45.071+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:45.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:45.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:46.038 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:46.027+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:46.456 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:46.443+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:47.059 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:47.047+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:47.446 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:47.431+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:48.066 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:48.055+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:48.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:48.399+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:49.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:49.019+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:49.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:49.399+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:50.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:50.035+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:50.403 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:50.391+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:51.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:51.031+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:51.432 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:51.419+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:52.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:52.007+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:52.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:52.443+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:52.996 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:52.983+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:53.422 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:53.411+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:54.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:54.023+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:54.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:54.427+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:55.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:55.019+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:55.452 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:55.439+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:56.027 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:56.015+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:56.496 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:56.483+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:57.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:57.015+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:57.470 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:57.459+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:58.059 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:58.047+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:58.425 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:58.411+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:35:59.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:35:59.035+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:35:59.470 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:35:59.459+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:00.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:00.075+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:00.518 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:00.507+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:01.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:01.127+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:01.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:01.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:02.106 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:02.095+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:02.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:02.451+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:03.069 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:03.055+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:03.459 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:03.447+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:04.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:04.103+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:04.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:04.451+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:05.082 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:05.071+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:05.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:05.451+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:06.101 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:06.087+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:06.456 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:06.443+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:07.087 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:07.075+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:07.460 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:07.447+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:08.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:08.083+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:08.493 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:08.479+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:09.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:09.091+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:09.493 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:09.479+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:10.145 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:10.131+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:10.505 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:10.491+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:11.111 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:11.099+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:11.461 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:11.447+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:12.122 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:12.111+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:12.438 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:12.427+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:13.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:13.075+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:13.477 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:13.463+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:14.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:14.083+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:14.488 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:14.475+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:15.111 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:15.099+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:15.482 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:15.467+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:16.145 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:16.131+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:16.487 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:16.475+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:17.145 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:17.131+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:17.495 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:17.483+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:18.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:18.119+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:18.511 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:18.499+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:19.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:19.119+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:19.470 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:19.459+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:20.152 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:20.139+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:20.497 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:20.483+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:21.122 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:21.111+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:21.485 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:21.471+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:22.119 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:22.107+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:22.449 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:22.435+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:23.082 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:23.071+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:23.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:23.451+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:24.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:24.067+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:24.418 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:24.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:25.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:25.043+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:25.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:25.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:26.063 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:26.051+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:26.400 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:26.387+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:27.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:27.063+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:27.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:27.411+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:28.068 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:28.055+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:28.426 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:28.411+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:29.078 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:29.063+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:29.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:29.427+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:30.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:30.071+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:30.451 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:30.439+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:31.122 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:31.111+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:31.432 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:31.419+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:32.154 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:32.139+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:32.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:32.435+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:33.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:33.127+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:33.437 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:33.423+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:34.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:34.167+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:34.432 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:34.419+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:35.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:35.131+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:35.388 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:35.375+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:36.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:36.175+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:36.429 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:36.415+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:37.218 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:37.207+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:37.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:37.411+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:38.187 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:38.175+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:38.448 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:38.435+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:39.176 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:39.163+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:39.449 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:39.435+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:40.139 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:40.127+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:40.413 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:40.399+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:41.115 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:41.103+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:41.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:41.379+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:42.099 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:42.087+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:42.382 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:42.371+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:43.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:43.067+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:43.394 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:43.383+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:44.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:44.067+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:44.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:44.427+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:45.074 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:45.059+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:45.426 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:45.411+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:46.105 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:46.091+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:46.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:46.427+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:47.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:47.119+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:47.432 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:47.419+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:48.173 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:48.159+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:48.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:48.399+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:49.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:49.183+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:49.452 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:49.439+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:50.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:50.163+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:50.451 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:50.439+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:51.207 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:51.195+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:51.491 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:51.479+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:52.222 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:52.211+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:52.467 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:52.455+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:53.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:53.207+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:53.443 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:53.431+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:54.258 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:54.247+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:54.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:54.419+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:55.301 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:55.287+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:55.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:55.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:56.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:56.315+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:56.447 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:56.435+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:57.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:57.335+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:57.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:57.423+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:58.383 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:58.370+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:58.437 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:58.422+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:36:59.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:36:59.350+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:36:59.423 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:36:59.410+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:00.410 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:00.398+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:00.438 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:00.426+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:01.460 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:01.446+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:01.461 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:01.446+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:02.473 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:02.458+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:02.507 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:02.494+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:03.486 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:03.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:03.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:03.474+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:04.479 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:04.466+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:04.491 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:04.478+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:05.435 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:05.422+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:05.496 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:05.482+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:06.451 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:06.438+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:06.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:06.454+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:07.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:07.406+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:07.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:07.430+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:08.400 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:08.386+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:08.481 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:08.466+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:09.445 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:09.430+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:09.456 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:09.442+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:10.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:10.386+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:10.504 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:10.490+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:11.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:11.398+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:11.552 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:11.538+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:12.390 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:12.374+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:12.562 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:12.546+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:13.360 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:13.346+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:13.593 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:13.578+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:14.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:14.354+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:14.621 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:14.606+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:15.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:15.330+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:15.641 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:15.626+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:16.326 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:16.314+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:16.693 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:16.678+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:17.301 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:17.286+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:17.712 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:17.698+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:18.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:18.298+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:18.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:18.734+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:19.283 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:19.270+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:19.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:19.778+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:20.312 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:20.298+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:20.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:20.822+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:21.330 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:21.318+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:21.823 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:21.810+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:22.291 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:22.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:22.859 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:22.846+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:23.251 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:23.238+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:23.846 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:23.834+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:24.289 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:24.274+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:24.857 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:24.842+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:25.330 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:25.318+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:25.889 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:25.874+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:26.330 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:26.318+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:26.901 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:26.886+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:27.305 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:27.290+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:27.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:27.918+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:28.294 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:28.282+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:28.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:28.910+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:29.293 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:29.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:29.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:29.942+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:30.325 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:30.310+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:30.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:30.922+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:31.353 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:31.338+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:31.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:31.930+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:32.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:32.298+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:32.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:32.902+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:33.310 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:33.298+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:33.947 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:33.934+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:34.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:34.314+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:34.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:34.930+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:35.358 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:35.346+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:35.989 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:35.974+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:36.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:36.334+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:36.946 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:36.934+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:37.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:37.298+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:37.993 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:37.978+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:38.287 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:38.274+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:38.967 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:38.954+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:39.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:39.274+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:39.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:39.934+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:40.314 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:40.302+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:40.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:40.958+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:41.335 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:41.322+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:42.019 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:42.006+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:42.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:42.358+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:43.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:42.994+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:43.415 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:43.402+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:43.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:43.966+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:44.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:44.386+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:44.952 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:44.938+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:45.414 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:45.402+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:45.921 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:45.906+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:46.416 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:46.402+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:46.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:46.918+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:47.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:47.378+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:47.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:47.962+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:48.357 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:48.342+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:48.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:48.914+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:49.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:49.386+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:49.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:49.942+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:50.431 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:50.418+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:50.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:50.966+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:51.433 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:51.418+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:51.973 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:51.958+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:52.448 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:52.434+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:52.995 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:52.982+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:53.497 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:53.482+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:53.996 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:53.982+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:54.497 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:54.482+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:55.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:54.986+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:55.485 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:55.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:56.040 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:56.026+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:56.502 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:56.490+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:57.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:57.058+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:57.540 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:57.526+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:58.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:58.074+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:58.511 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:58.498+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:37:59.082 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:37:59.066+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:37:59.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:37:59.450+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:00.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:00.066+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:00.467 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:00.454+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:01.117 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:01.102+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:01.443 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:01.430+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:02.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:02.146+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:02.435 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:02.422+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:03.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:03.130+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:03.437 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:03.422+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:04.185 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:04.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:04.460 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:04.446+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:05.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:05.166+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:05.485 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:05.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:06.177 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:06.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:06.521 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:06.506+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:07.147 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:07.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:07.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:07.458+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:08.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:08.118+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:08.429 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:08.414+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:09.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:09.070+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:09.442 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:09.426+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:10.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:10.082+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:10.484 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:10.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:11.113 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:11.098+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:11.469 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:11.454+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:12.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:12.110+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:12.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:12.450+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:13.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:13.078+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:13.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:13.450+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:14.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:14.078+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:14.456 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:14.442+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:15.137 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:15.122+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:15.485 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:15.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:16.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:16.078+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:16.467 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:16.454+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:17.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:17.070+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:17.514 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:17.498+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:18.073 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:18.058+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:18.543 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:18.530+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:19.027 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:19.014+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:19.504 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:19.490+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:20.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:20.042+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:20.514 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:20.498+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:21.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:21.062+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:21.547 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:21.534+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:22.110 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:22.098+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:22.545 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:22.530+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:23.110 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:23.098+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:23.569 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:23.554+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:24.150 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:24.138+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:24.610 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:24.598+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:25.113 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:25.098+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:25.618 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:25.606+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:26.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:26.130+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:26.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:26.590+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:27.115 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:27.102+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:27.569 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:27.554+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:28.090 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:28.078+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:28.533 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:28.518+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:29.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:29.082+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:29.533 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:29.518+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:30.087 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:30.074+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:30.564 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:30.550+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:31.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:31.102+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:31.585 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:31.570+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:32.159 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:32.146+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:32.635 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:32.622+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:33.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:33.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:33.680 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:33.666+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:34.163 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:34.150+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:34.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:34.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:35.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:35.166+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:35.744 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:35.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:36.229 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:36.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:36.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:36.770+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:37.200 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:37.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:37.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:37.782+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:38.243 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:38.230+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:38.767 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:38.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:39.272 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:39.258+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:39.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:39.774+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:40.239 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:40.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:40.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:40.802+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:41.247 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:41.234+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:41.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:41.818+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:42.207 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:42.194+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:42.877 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:42.862+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:43.246 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:43.234+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:43.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:43.842+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:44.217 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:44.202+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:44.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:44.818+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:45.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:45.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:45.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:45.818+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:46.183 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:46.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:46.794 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:46.782+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:47.187 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:47.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:47.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:47.794+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:48.232 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:48.218+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:48.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:48.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:49.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:49.262+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:49.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:49.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:50.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:50.262+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:50.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:50.770+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:51.228 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:51.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:51.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:51.790+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:52.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:52.166+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:52.761 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:52.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:53.214 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:53.198+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:53.729 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:53.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:54.187 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:54.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:54.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:54.702+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:55.208 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:55.194+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:55.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:55.670+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:56.229 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:56.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:56.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:56.658+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:57.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:57.238+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:57.638 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:57.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:58.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:58.238+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:58.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:58.654+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:38:59.227 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:38:59.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:38:59.619 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:38:59.606+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:00.223 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:00.210+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:00.651 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:00.638+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:01.223 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:01.210+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:01.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:01.670+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:02.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:02.238+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:02.686 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:02.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:03.239 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:03.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:03.734 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:03.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:04.268 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:04.254+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:04.706 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:04.693+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:05.248 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:05.233+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:05.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:05.733+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:06.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:06.229+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:06.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:06.741+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:07.244 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:07.229+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:07.800 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:07.785+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:08.228 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:08.213+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:08.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:08.769+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:09.193 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:09.177+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:09.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:09.725+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:10.157 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:10.141+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:10.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:10.705+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:11.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:11.165+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:11.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:11.741+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:12.151 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:12.137+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:12.740 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:12.725+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:13.190 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:13.173+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:13.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:13.761+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:14.225 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:14.209+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:14.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:14.741+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:15.197 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:15.181+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:15.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:15.769+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:16.244 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:16.233+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:16.740 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:16.729+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:17.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:17.185+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:17.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:17.745+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:18.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:18.221+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:18.762 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:18.745+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:19.250 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:19.237+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:19.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:19.797+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:20.223 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:20.213+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:20.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:20.769+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:21.224 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:21.213+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:21.813 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:21.801+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:22.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:22.169+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:22.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:22.809+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:23.148 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:23.137+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:23.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:23.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:24.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:24.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:24.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:24.785+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:25.154 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:25.145+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:25.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:25.749+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:26.159 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:26.149+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:26.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:26.713+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:27.137 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:27.125+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:27.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:27.693+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:28.157 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:28.145+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:28.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:28.669+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:29.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:29.181+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:29.678 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:29.665+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:30.171 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:30.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:30.649 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:30.637+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:31.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:31.201+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:31.620 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:31.609+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:32.256 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:32.245+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:32.614 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:32.605+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:33.245 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:33.233+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:33.631 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:33.621+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:34.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:34.209+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:34.641 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:34.629+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:35.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:35.165+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:35.688 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:35.677+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:36.148 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:36.137+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:36.708 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:36.697+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:37.165 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:37.153+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:37.739 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:37.729+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:38.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:38.121+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:38.736 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:38.725+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:39.150 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:39.141+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:39.739 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:39.729+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:40.119 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:40.109+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:40.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:40.753+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:41.123 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:41.113+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:41.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:41.737+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:42.123 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:42.113+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:42.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:42.785+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:43.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:43.073+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:43.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:43.745+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:44.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:44.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:44.714 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:44.701+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:45.131 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:45.121+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:45.691 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:45.681+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:46.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:46.101+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:46.689 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:46.677+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:47.097 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:47.085+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:47.644 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:47.633+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:48.108 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:48.097+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:48.601 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:48.589+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:49.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:49.081+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:49.626 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:49.613+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:50.107 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:50.097+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:50.630 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:50.617+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:51.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:51.061+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:51.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:51.637+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:52.046 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:52.037+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:52.616 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:52.605+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:53.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:53.001+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:53.654 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:53.641+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:53.992 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:53.981+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:54.640 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:54.629+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:54.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:54.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:55.595 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:55.585+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:55.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:55.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:56.585 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:56.573+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:56.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:56.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:57.551 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:57.541+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:57.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:57.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:58.543 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:58.533+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:39:58.994 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:39:58.985+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:39:59.579 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:39:59.569+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:00.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:00.017+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:00.608 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:00.597+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:00.983 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:00.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:01.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:01.617+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:01.993 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:01.981+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:02.612 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:02.601+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:02.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:02.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:03.602 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:03.581+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:03.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:03.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:04.546 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:04.533+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:04.933 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:04.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:05.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:05.525+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:05.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:05.937+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:06.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:06.497+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:06.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:06.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:07.483 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:07.473+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:07.960 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:07.949+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:08.517 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:08.505+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:08.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:08.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:09.530 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:09.521+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:10.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:10.009+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:10.485 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:10.473+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:11.059 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:11.049+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:11.535 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:11.525+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:12.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:12.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:12.581 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:12.569+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:13.065 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:13.053+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:13.589 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:13.577+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:14.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:14.009+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:14.546 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:14.533+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:15.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:15.005+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:15.575 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:15.561+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:16.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:16.045+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:16.574 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:16.561+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:17.049 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:17.037+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:17.577 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:17.565+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:18.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:18.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:18.609 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:18.597+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:19.012 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:19.001+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:19.589 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:19.577+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:20.038 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:20.025+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:20.621 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:20.609+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:21.073 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:21.061+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:21.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:21.661+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:22.036 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:22.021+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:22.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:22.621+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:23.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:23.025+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:23.668 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:23.657+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:24.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:24.069+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:24.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:24.705+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:25.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:25.105+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:25.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:25.697+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:26.167 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:26.157+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:26.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:26.665+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:27.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:27.145+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:27.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:27.621+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:28.167 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:28.157+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:28.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:28.665+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:29.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:29.145+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:29.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:29.693+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:30.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:30.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:30.673 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:30.661+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:31.218 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:31.209+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:31.702 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:31.693+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:32.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:32.185+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:32.742 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:32.733+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:33.205 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:33.193+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:33.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:33.705+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:34.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:34.165+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:34.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:34.705+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:35.211 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:35.201+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:35.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:35.717+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:36.216 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:36.205+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:36.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:36.753+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:37.268 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:37.257+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:37.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:37.761+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:38.228 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:38.217+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:38.773 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:38.761+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:39.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:39.169+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:39.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:39.765+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:40.133 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:40.121+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:40.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:40.769+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:41.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:41.133+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:41.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:41.797+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:42.133 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:42.121+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:42.772 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:42.761+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:43.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:43.125+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:43.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:43.769+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:44.097 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:44.085+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:44.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:44.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:45.100 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:45.089+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:45.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:45.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:46.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:46.057+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:46.881 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:46.869+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:47.099 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:47.089+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:47.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:47.837+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:48.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:48.109+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:48.814 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:48.801+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:49.163 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:49.153+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:49.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:49.809+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:50.137 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:50.125+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:50.843 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:50.833+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:51.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:51.125+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:51.885 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:51.873+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:52.117 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:52.105+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:52.920 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:52.909+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:53.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:53.077+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:53.931 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:53.921+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:54.048 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:54.037+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:54.957 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:54.945+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:55.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:55.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:55.971 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:55.961+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:55.998 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:55.985+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:56.967 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:56.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:56.975 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:56.965+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:57.944 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:57.933+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:57.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:57.941+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:58.944 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:58.933+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:40:58.988 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:58.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:40:59.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:40:59.937+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:00.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:40:59.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:00.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:00.965+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:01.060 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:01.049+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:02.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:01.993+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:02.094 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:02.085+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:03.045 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:03.033+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:03.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:03.093+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:04.020 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:04.004+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:04.096 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:04.084+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:04.975 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:04.964+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:05.059 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:05.048+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:05.971 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:05.960+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:06.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:06.004+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:06.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:06.968+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:07.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:06.988+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:07.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:07.948+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:07.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:07.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:08.936 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:08.924+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:08.939 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:08.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:09.925 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:09.912+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:09.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:09.936+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:10.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:10.900+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:10.987 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:10.976+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:11.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:11.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:12.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:12.004+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:12.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:12.964+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:12.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:12.968+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:13.958 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:13.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:14.008 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:13.996+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:14.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:14.904+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:15.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:15.000+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:15.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:15.900+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:16.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:16.044+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:16.905 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:16.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:17.021 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:17.008+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:17.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:17.884+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:18.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:18.040+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:18.862 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:18.848+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:19.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:19.036+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:19.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:19.812+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:20.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:20.016+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:20.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:20.792+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:21.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:21.012+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:21.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:21.796+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:21.989 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:21.976+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:22.794 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:22.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:23.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:23.004+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:23.771 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:23.760+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:23.989 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:23.976+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:24.820 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:24.808+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:24.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:24.936+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:25.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:25.856+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:25.901 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:25.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:26.866 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:26.852+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:26.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:26.932+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:27.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:27.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:27.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:27.952+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:28.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:28.828+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:28.939 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:28.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:29.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:29.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:29.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:29.952+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:30.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:30.820+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:30.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:30.960+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:31.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:31.792+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:31.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:31.936+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:32.833 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:32.820+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:32.920 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:32.908+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:33.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:33.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:33.951 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:33.940+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:34.820 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:34.808+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:34.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:34.896+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:35.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:35.808+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:35.928 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:35.916+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:36.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:36.772+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:36.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:36.892+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:37.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:37.812+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:37.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:37.916+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:38.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:38.812+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:38.923 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:38.912+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:39.859 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:39.848+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:39.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:39.944+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:40.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:40.864+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:40.952 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:40.940+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:41.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:41.820+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:41.980 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:41.968+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:42.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:42.860+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:42.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:42.956+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:43.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:43.884+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:43.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:43.924+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:44.946 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:44.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:44.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:44.968+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:45.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:45.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:45.966 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:45.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:46.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:46.948+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:46.986 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:46.972+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:47.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:47.944+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:48.034 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:48.024+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:48.936 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:48.924+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:49.019 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:49.008+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:49.941 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:49.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:50.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:50.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:50.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:50.884+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:51.083 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:51.072+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:51.892 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:51.880+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:52.134 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:52.120+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:52.899 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:52.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:53.139 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:53.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:53.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:53.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:54.098 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:54.088+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:54.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:54.808+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:55.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:55.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:55.830 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:55.820+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:56.137 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:56.124+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:56.837 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:56.824+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:57.152 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:57.140+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:57.871 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:57.860+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:58.183 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:58.172+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:58.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:58.816+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:41:59.149 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:41:59.136+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:41:59.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:41:59.828+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:00.167 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:00.156+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:00.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:00.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:01.211 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:01.200+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:01.808 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:01.796+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:02.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:02.180+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:02.790 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:02.780+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:03.168 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:03.156+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:03.832 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:03.820+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:04.176 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:04.164+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:04.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:04.808+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:05.207 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:05.196+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:05.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:05.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:06.236 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:06.224+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:06.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:06.800+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:07.217 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:07.204+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:07.843 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:07.832+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:08.263 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:08.252+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:08.841 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:08.828+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:09.254 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:09.244+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:09.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:09.800+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:10.213 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:10.200+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:10.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:10.792+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:11.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:11.196+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:11.825 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:11.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:12.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:12.180+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:12.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:12.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:13.224 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:13.212+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:13.843 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:13.832+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:14.238 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:14.228+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:14.825 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:14.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:15.267 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:15.256+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:15.807 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:15.796+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:16.283 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:16.272+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:16.777 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:16.764+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:17.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:17.228+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:17.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:17.728+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:18.222 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:18.212+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:18.762 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:18.752+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:19.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:19.260+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:19.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:19.800+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:20.323 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:20.312+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:20.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:20.800+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:21.286 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:21.272+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:21.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:21.816+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:22.322 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:22.308+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:22.829 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:22.816+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:23.316 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:23.304+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:23.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:23.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:24.327 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:24.316+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:24.753 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:24.740+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:25.305 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:25.292+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:25.788 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:25.776+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:26.261 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:26.248+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:26.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:26.760+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:27.252 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:27.240+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:27.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:27.800+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:28.212 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:28.200+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:28.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:28.780+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:29.243 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:29.232+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:29.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:29.808+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:30.275 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:30.264+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:30.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:30.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:31.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:31.228+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:31.831 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:31.820+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:32.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:32.212+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:32.863 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:32.852+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:33.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:33.184+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:33.890 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:33.880+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:34.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:34.184+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:34.869 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:34.856+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:35.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:35.180+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:35.881 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:35.868+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:36.188 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:36.176+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:36.861 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:36.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:37.202 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:37.188+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:37.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:37.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:38.179 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:38.168+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:38.778 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:38.764+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:39.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:39.196+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:39.800 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:39.788+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:40.197 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:40.184+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:40.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:40.784+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:41.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:41.212+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:41.798 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:41.788+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:42.225 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:42.212+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:42.772 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:42.760+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:43.263 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:43.252+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:43.728 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:43.716+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:44.246 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:44.232+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:44.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:44.760+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:45.286 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:45.276+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:45.744 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:45.732+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:46.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:46.296+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:46.787 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:46.776+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:47.342 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:47.328+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:47.837 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:47.824+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:48.352 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:48.336+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:48.838 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:48.824+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:49.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:49.324+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:49.885 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:49.872+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:50.323 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:50.312+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:50.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:50.828+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:51.366 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:51.356+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:51.809 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:51.796+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:52.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:52.372+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:52.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:52.796+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:53.339 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:53.328+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:53.765 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:53.752+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:54.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:54.312+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:54.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:54.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:55.332 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:55.320+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:55.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:55.764+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:56.354 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:56.344+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:56.769 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:56.756+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:57.340 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:57.328+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:57.771 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:57.759+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:58.303 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:58.291+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:58.755 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:58.743+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:42:59.330 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:42:59.319+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:42:59.782 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:42:59.771+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:00.357 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:00.343+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:00.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:00.787+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:01.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:01.331+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:01.773 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:01.759+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:02.390 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:02.379+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:02.807 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:02.795+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:03.416 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:03.403+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:03.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:03.771+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:04.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:04.379+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:04.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:04.803+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:05.366 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:05.351+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:05.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:05.771+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:06.319 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:06.307+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:06.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:06.803+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:07.336 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:07.323+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:07.828 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:07.811+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:08.357 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:08.343+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:08.820 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:08.807+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:09.360 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:09.347+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:09.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:09.811+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:10.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:10.367+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:10.861 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:10.847+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:11.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:11.399+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:11.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:11.803+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:12.451 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:12.435+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:12.846 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:12.835+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:13.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:13.443+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:13.821 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:13.807+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:14.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:14.451+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:14.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:14.811+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:15.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:15.419+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:15.861 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:15.847+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:16.433 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:16.419+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:16.842 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:16.827+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:17.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:17.415+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:17.795 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:17.783+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:18.406 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:18.395+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:18.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:18.811+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:19.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:19.371+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:19.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:19.771+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:20.393 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:20.379+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:20.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:20.783+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:21.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:21.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:21.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:21.807+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:22.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:22.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:22.855 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:22.843+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:23.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:23.399+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:23.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:23.811+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:24.431 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:24.419+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:24.838 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:24.827+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:25.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:25.423+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:25.846 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:25.835+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:26.408 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:26.395+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:26.839 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:26.827+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:27.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:27.427+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:27.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:27.811+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:28.447 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:28.435+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:28.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:28.839+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:29.432 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:29.419+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:29.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:29.791+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:30.451 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:30.439+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:30.829 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:30.815+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:31.471 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:31.459+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:31.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:31.823+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:32.521 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:32.507+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:32.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:32.839+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:33.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:33.515+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:33.888 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:33.875+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:34.551 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:34.539+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:34.871 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:34.859+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:35.523 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:35.511+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:35.839 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:35.823+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:36.532 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:36.519+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:36.884 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:36.871+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:37.501 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:37.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:37.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:37.839+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:38.503 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:38.491+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:38.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:38.843+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:39.509 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:39.491+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:39.855 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:39.843+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:40.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:40.495+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:40.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:40.863+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:41.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:41.455+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:41.890 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:41.879+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:42.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:42.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:42.886 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:42.871+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:43.451 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:43.439+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:43.873 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:43.859+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:44.489 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:44.475+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:44.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:44.839+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:45.502 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:45.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:45.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:45.823+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:46.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:46.443+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:46.867 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:46.855+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:47.425 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:47.411+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:47.863 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:47.851+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:48.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:48.379+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:48.866 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:48.855+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:49.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:49.391+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:49.838 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:49.827+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:50.376 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:50.363+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:50.878 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:50.867+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:51.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:51.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:51.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:51.839+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:52.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:52.439+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:52.892 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:52.879+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:53.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:53.451+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:53.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:53.835+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:54.481 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:54.467+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:54.858 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:54.847+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:55.522 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:55.511+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:55.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:55.839+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:56.505 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:56.491+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:56.847 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:56.835+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:57.516 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:57.503+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:57.837 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:57.823+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:58.504 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:58.491+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:58.866 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:58.855+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:43:59.491 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:43:59.479+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:43:59.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:43:59.891+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:00.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:00.511+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:00.900 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:00.887+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:01.535 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:01.523+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:01.936 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:01.923+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:02.522 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:02.511+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:02.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:02.903+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:03.519 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:03.507+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:03.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:03.915+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:04.501 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:04.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:04.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:04.895+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:05.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:05.451+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:05.904 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:05.891+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:06.461 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:06.447+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:06.906 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:06.891+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:07.445 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:07.431+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:07.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:07.907+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:08.483 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:08.471+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:08.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:08.923+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:09.467 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:09.455+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:09.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:09.935+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:10.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:10.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:10.911 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:10.899+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:11.519 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:11.507+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:11.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:11.911+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:12.533 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:12.519+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:12.886 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:12.875+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:13.513 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:13.499+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:13.857 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:13.843+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:14.561 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:14.547+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:14.906 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:14.895+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:15.546 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:15.531+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:15.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:15.903+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:16.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:16.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:16.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:16.863+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:17.486 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:17.471+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:17.829 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:17.815+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:18.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:18.451+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:18.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:18.791+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:19.485 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:19.471+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:19.776 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:19.763+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:20.483 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:20.471+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:20.773 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:20.759+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:21.462 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:21.447+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:21.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:21.799+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:22.508 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:22.495+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:22.770 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:22.759+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:23.510 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:23.499+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:23.768 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:23.755+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:24.558 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:24.547+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:24.818 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:24.807+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:25.565 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:25.551+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:25.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:25.811+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:26.608 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:26.595+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:26.795 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:26.783+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:27.578 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:27.567+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:27.762 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:27.751+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:28.584 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:28.571+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:28.757 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:28.743+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:29.553 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:29.539+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:29.712 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:29.699+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:30.534 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:30.523+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:30.747 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:30.735+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:31.566 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:31.555+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:31.731 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:31.719+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:32.553 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:32.539+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:32.728 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:32.715+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:33.529 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:33.515+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:33.696 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:33.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:34.497 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:34.483+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:34.737 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:34.723+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:35.485 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:35.471+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:35.709 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:35.695+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:36.513 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:36.499+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:36.742 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:36.731+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:37.470 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:37.455+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:37.762 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:37.751+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:38.443 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:38.431+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:38.807 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:38.795+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:39.408 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:39.395+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:39.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:39.783+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:40.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:40.367+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:40.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:40.783+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:41.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:41.411+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:41.787 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:41.775+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:42.444 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:42.431+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:42.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:42.823+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:43.417 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:43.403+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:43.789 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:43.775+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:44.443 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:44.431+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:44.783 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:44.771+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:45.462 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:45.451+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:45.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:45.779+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:46.423 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:46.411+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:46.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:46.771+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:47.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:47.414+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:47.814 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:47.802+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:48.419 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:48.406+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:48.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:48.838+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:49.413 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:49.398+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:49.904 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:49.890+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:50.447 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:50.434+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:50.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:50.918+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:51.497 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:51.482+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:51.904 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:51.890+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:52.469 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:52.454+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:52.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:52.902+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:53.458 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:53.446+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:53.952 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:53.938+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:54.419 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:54.406+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:54.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:54.950+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:55.426 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:55.414+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:55.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:55.914+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:56.425 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:56.410+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:56.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:56.870+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:57.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:57.414+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:57.841 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:57.826+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:58.403 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:58.390+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:58.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:58.786+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:44:59.413 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:44:59.398+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:44:59.846 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:44:59.834+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:00.388 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:00.374+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:00.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:00.834+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:01.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:01.346+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:01.829 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:01.814+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:02.355 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:02.342+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:02.880 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:02.866+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:03.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:03.334+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:03.911 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:03.898+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:04.304 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:04.290+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:04.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:04.930+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:05.295 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:05.282+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:05.939 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:05.926+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:06.251 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:06.238+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:06.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:06.890+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:07.299 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:07.286+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:07.859 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:07.846+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:08.264 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:08.250+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:08.861 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:08.846+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:09.221 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:09.206+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:09.900 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:09.886+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:10.189 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:10.174+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:10.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:10.918+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:11.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:11.146+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:11.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:11.946+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:12.207 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:12.194+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:12.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:12.926+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:13.212 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:13.198+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:13.950 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:13.938+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:14.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:14.194+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:14.928 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:14.914+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:15.175 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:15.162+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:15.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:15.914+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:16.157 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:16.142+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:16.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:16.910+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:17.123 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:17.110+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:17.961 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:17.946+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:18.081 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:18.066+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:18.927 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:18.914+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:19.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:19.050+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:19.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:19.930+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:20.017 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:20.002+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:20.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:20.950+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:21.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:21.002+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:21.973 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:21.958+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:22.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:21.998+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:23.010 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:22.994+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:23.019 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:23.006+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:24.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:23.994+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:24.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:23.998+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:24.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:24.970+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:24.983 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:24.970+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:25.948 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:25.934+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:25.986 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:25.974+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:26.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:26.906+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:26.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:26.938+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:27.877 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:27.862+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:27.935 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:27.922+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:28.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:28.842+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:28.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:28.878+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:29.906 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:29.894+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:29.920 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:29.906+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:30.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:30.918+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:30.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:30.942+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:31.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:31.902+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:31.936 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:31.922+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:32.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:32.890+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:32.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:32.894+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:33.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:33.862+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:33.879 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:33.866+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:34.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:34.886+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:34.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:34.902+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:35.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:35.870+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:35.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:35.950+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:36.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:36.902+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:36.962 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:36.946+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:37.881 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:37.866+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:38.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:37.990+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:38.864 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:38.850+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:38.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:38.966+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:39.843 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:39.830+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:40.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:39.986+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:40.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:40.802+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:41.004 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:40.990+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:41.833 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:41.818+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:41.993 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:41.978+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:42.866 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:42.850+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:42.961 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:42.946+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:43.901 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:43.886+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:43.974 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:43.958+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:44.912 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:44.898+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:44.973 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:44.958+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:45.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:45.882+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:45.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:45.950+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:46.905 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:46.890+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:47.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:46.998+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:47.864 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:47.850+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:47.971 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:47.958+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:48.833 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:48.818+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:49.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:48.986+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:49.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:49.782+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:50.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:50.022+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:50.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:50.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:50.996 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:50.982+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:51.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:51.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:51.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:51.958+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:52.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:52.778+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:52.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:52.934+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:53.838 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:53.822+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:53.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:53.962+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:54.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:54.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:54.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:54.950+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:55.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:55.834+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:55.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:55.902+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:56.836 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:56.822+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:56.918 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:56.902+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:57.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:57.842+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:57.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:57.862+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:58.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:58.874+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:58.920 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:58.906+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:45:59.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:45:59.858+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:45:59.942 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:45:59.930+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:00.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:00.830+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:00.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:00.902+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:01.882 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:01.866+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:01.946 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:01.934+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:02.902 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:02.886+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:02.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:02.942+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:03.895 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:03.882+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:03.969 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:03.954+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:04.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:04.906+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:05.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:04.998+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:05.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:05.866+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:06.039 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:06.026+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:06.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:06.818+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:07.027 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:07.014+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:07.818 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:07.806+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:08.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:08.058+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:08.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:08.774+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:09.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:09.078+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:09.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:09.810+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:10.044 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:10.030+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:10.821 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:10.806+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:11.077 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:11.062+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:11.859 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:11.846+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:12.125 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:12.110+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:12.877 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:12.862+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:13.148 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:13.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:13.923 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:13.910+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:14.127 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:14.114+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:14.943 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:14.930+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:15.127 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:15.114+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:15.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:15.950+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:16.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:16.146+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:16.984 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:16.970+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:17.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:17.166+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:17.952 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:17.938+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:18.156 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:18.142+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:18.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:18.946+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:19.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:19.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:19.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:19.922+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:20.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:20.146+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:20.938 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:20.926+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:21.173 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:21.158+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:21.960 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:21.946+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:22.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:22.154+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:22.975 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:22.962+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:23.213 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:23.198+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:24.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:24.002+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:24.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:24.154+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:25.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:24.990+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:25.124 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:25.110+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:25.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:25.966+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:26.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:26.066+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:26.939 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:26.926+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:27.048 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:27.034+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:27.984 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:27.970+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:28.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:27.986+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:28.937 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:28.922+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:28.971 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:28.958+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:29.923 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:29.910+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:30.021 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:30.006+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:30.894 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:30.882+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:31.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:31.046+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:31.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:31.834+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:32.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:32.010+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:32.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:32.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:33.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:32.989+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:33.874 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:33.857+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:34.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:33.989+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:34.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:34.901+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:34.971 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:34.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:35.899 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:35.885+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:35.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:35.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:36.901 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:36.885+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:36.941 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:36.925+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:37.862 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:37.849+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:37.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:37.917+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:38.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:38.877+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:38.975 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:38.961+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:39.904 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:39.889+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:39.926 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:39.909+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:40.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:40.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:40.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:40.921+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:41.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:41.893+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:41.913 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:41.901+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:42.901 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:42.889+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:42.931 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:42.917+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:43.859 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:43.845+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:43.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:43.961+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:44.874 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:44.861+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:44.965 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:44.953+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:45.848 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:45.837+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:45.957 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:45.945+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:46.809 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:46.797+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:46.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:46.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:47.842 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:47.833+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:48.023 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:48.013+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:48.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:48.785+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:49.051 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:49.041+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:49.778 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:49.765+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:50.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:50.005+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:50.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:50.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:51.052 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:51.041+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:51.861 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:51.849+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:52.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:52.029+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:52.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:52.845+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:53.019 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:53.009+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:53.846 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:53.837+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:54.020 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:54.009+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:54.809 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:54.797+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:55.062 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:55.049+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:55.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:55.805+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:56.090 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:56.081+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:56.823 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:56.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:57.092 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:57.081+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:57.795 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:57.785+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:58.088 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:58.077+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:58.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:58.789+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:46:59.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:46:59.057+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:46:59.806 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:46:59.797+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:00.081 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:00.069+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:00.818 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:00.805+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:01.068 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:01.057+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:01.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:01.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:02.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:02.073+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:02.873 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:02.861+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:03.121 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:03.109+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:03.902 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:03.893+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:04.155 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:04.145+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:04.865 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:04.853+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:05.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:05.177+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:05.878 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:05.869+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:06.161 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:06.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:06.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:06.825+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:07.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:07.197+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:07.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:07.809+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:08.202 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:08.189+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:08.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:08.765+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:09.174 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:09.165+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:09.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:09.797+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:10.224 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:10.213+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:10.767 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:10.757+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:11.188 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:11.177+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:11.719 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:11.709+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:12.230 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:12.221+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:12.696 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:12.685+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:13.246 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:13.233+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:13.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:13.725+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:14.297 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:14.285+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:14.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:14.769+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:15.262 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:15.253+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:15.733 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:15.721+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:16.274 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:16.261+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:16.712 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:16.701+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:17.234 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:17.221+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:17.742 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:17.733+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:18.250 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:18.241+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:18.742 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:18.729+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:19.247 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:19.237+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:19.770 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:19.757+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:20.261 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:20.249+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:20.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:20.773+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:21.227 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:21.217+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:21.802 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:21.789+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:22.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:22.181+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:22.846 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:22.837+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:23.182 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:23.173+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:23.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:23.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:24.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:24.177+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:24.842 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:24.833+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:25.238 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:25.229+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:25.812 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:25.801+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:26.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:26.185+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:26.802 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:26.793+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:27.207 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:27.197+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:27.798 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:27.789+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:28.227 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:28.217+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:28.842 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:28.829+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:29.245 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:29.233+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:29.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:29.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:30.243 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:30.233+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:30.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:30.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:31.197 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:31.185+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:31.830 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:31.817+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:32.150 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:32.137+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:32.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:32.793+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:33.116 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:33.105+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:33.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:33.825+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:34.141 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:34.129+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:34.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:34.781+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:35.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:35.093+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:35.837 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:35.825+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:36.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:36.045+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:36.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:36.829+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:37.078 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:37.065+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:37.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:37.825+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:38.080 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:38.069+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:38.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:38.829+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:39.130 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:39.117+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:39.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:39.801+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:40.097 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:40.085+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:40.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:40.809+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:41.148 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:41.137+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:41.808 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:41.797+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:42.163 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:42.153+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:42.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:42.817+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:43.189 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:43.177+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:43.878 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:43.865+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:44.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:44.181+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:44.889 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:44.877+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:45.202 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:45.189+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:45.905 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:45.893+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:46.161 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:46.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:46.921 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:46.909+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:47.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:47.181+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:47.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:47.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:48.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:48.185+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:48.885 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:48.873+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:49.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:49.141+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:49.924 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:49.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:50.204 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:50.193+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:50.912 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:50.901+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:51.171 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:51.161+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:51.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:51.893+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:52.131 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:52.121+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:52.920 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:52.909+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:53.095 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:53.085+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:53.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:53.897+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:54.093 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:54.077+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:54.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:54.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:55.139 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:55.129+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:55.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:55.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:56.095 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:56.085+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:56.977 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:56.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:57.068 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:57.057+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:57.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:57.937+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:58.045 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:58.033+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:58.994 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:58.985+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:59.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:58.989+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:47:59.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:47:59.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:47:59.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:47:59.961+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:00.996 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:00.985+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:01.020 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:01.009+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:01.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:01.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:01.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:01.989+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:02.985 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:02.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:03.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:03.009+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:03.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:03.949+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:04.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:04.001+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:05.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:04.993+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:05.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:05.001+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:05.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:05.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:06.062 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:06.049+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:07.015 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:07.005+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:07.093 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:07.081+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:07.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:07.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:08.132 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:08.121+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:08.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:08.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:09.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:09.101+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:09.954 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:09.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:10.161 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:10.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:10.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:10.905+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:11.131 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:11.121+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:11.898 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:11.885+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:12.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:12.093+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:12.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:12.865+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:13.101 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:13.089+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:13.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:13.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:14.136 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:14.125+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:14.848 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:14.837+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:15.185 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:15.173+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:15.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:15.801+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:16.220 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:16.208+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:16.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:16.844+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:17.175 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:17.164+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:17.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:17.836+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:18.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:18.172+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:18.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:18.872+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:19.190 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:19.176+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:19.882 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:19.868+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:20.205 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:20.192+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:20.884 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:20.872+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:21.234 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:21.220+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:21.928 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:21.916+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:22.275 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:22.264+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:22.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:22.952+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:23.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:23.288+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:23.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:23.932+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:24.269 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:24.256+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:24.988 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:24.976+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:25.237 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:25.224+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:26.014 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:26.000+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:26.270 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:26.256+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:26.987 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:26.976+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:27.240 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:27.228+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:28.019 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:28.008+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:28.214 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:28.204+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:29.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:28.988+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:29.174 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:29.160+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:30.004 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:29.992+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:30.147 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:30.136+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:31.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:30.996+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:31.183 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:31.172+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:32.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:31.996+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:32.175 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:32.164+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:32.971 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:32.960+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:33.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:33.148+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:34.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:34.008+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:34.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:34.140+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:35.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:34.988+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:35.171 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:35.160+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:36.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:35.996+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:36.184 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:36.172+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:37.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:37.032+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:37.214 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:37.200+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:38.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:38.016+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:38.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:38.180+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:39.051 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:39.040+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:39.162 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:39.152+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:40.059 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:40.048+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:40.173 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:40.160+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:41.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:41.008+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:41.141 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:41.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:41.973 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:41.960+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:42.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:42.168+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:43.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:43.012+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:43.143 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:43.132+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:43.994 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:43.984+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:44.194 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:44.180+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:44.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:44.964+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:45.219 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:45.208+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:45.994 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:45.984+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:46.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:46.164+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:47.037 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:47.024+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:47.198 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:47.188+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:48.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:47.996+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:48.155 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:48.144+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:49.003 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:48.992+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:49.139 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:49.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:50.040 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:50.028+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:50.101 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:50.088+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:51.090 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:51.080+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:51.106 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:51.092+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:52.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:52.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:52.086 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:52.076+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:53.058 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:53.044+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:53.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:53.092+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:54.081 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:54.068+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:54.115 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:54.104+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:55.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:55.032+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:55.087 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:55.076+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:56.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:56.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:56.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:56.076+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:57.026 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:57.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:57.133 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:57.120+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:58.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:58.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:58.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:58.132+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:48:59.028 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:48:59.016+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:48:59.169 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:48:59.156+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:00.020 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:00.008+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:00.216 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:00.204+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:01.019 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:01.008+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:01.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:01.156+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:01.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:01.976+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:02.176 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:02.164+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:02.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:02.968+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:03.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:03.132+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:04.019 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:04.008+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:04.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:04.120+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:05.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:04.988+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:05.137 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:05.124+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:05.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:05.980+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:06.123 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:06.112+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:07.011 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:07.000+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:07.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:07.120+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:07.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:07.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:08.131 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:08.120+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:08.985 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:08.972+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:09.096 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:09.084+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:09.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:09.984+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:10.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:10.092+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:10.961 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:10.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:11.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:11.124+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:11.971 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:11.960+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:12.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:12.092+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:12.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:12.968+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:13.128 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:13.116+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:14.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:14.016+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:14.161 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:14.148+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:15.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:15.024+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:15.209 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:15.196+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:16.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:16.004+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:16.243 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:16.228+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:17.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:16.988+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:17.258 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:17.248+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:17.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:17.940+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:18.278 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:18.268+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:18.940 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:18.928+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:19.256 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:19.244+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:19.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:19.940+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:20.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:20.208+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:20.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:20.920+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:21.254 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:21.244+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:21.929 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:21.916+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:22.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:22.244+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:22.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:22.916+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:23.265 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:23.252+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:23.957 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:23.944+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:24.311 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:24.300+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:24.980 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:24.968+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:25.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:25.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:25.993 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:25.980+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:26.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:26.240+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:27.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:27.000+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:27.229 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:27.216+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:28.023 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:28.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:28.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:28.168+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:29.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:29.028+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:29.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:29.124+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:29.998 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:29.988+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:30.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:30.116+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:30.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:30.976+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:31.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:31.104+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:31.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:31.980+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:32.161 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:32.148+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:33.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:33.000+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:33.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:33.176+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:34.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:34.032+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:34.156 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:34.144+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:35.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:35.072+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:35.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:35.108+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:36.126 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:36.112+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:36.153 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:36.140+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:37.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:37.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:37.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:37.132+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:38.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:38.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:38.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:38.144+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:39.136 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:39.124+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:39.142 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:39.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:40.148 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:40.136+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:40.185 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:40.172+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:41.144 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:41.132+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:41.161 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:41.148+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:42.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:42.088+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:42.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:42.132+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:43.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:43.140+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:43.160 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:43.148+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:44.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:44.144+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:44.161 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:44.148+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:45.113 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:45.100+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:45.117 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:45.104+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:46.076 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:46.064+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:46.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:46.116+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:47.112 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:47.100+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:47.167 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:47.156+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:48.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:48.076+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:48.161 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:48.148+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:49.060 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:49.048+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:49.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:49.128+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:50.036 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:50.024+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:50.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:50.132+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:51.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:50.988+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:51.174 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:51.164+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:51.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:51.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:52.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:52.184+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:52.943 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:52.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:53.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:53.200+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:53.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:53.904+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:54.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:54.176+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:54.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:54.956+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:55.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:55.132+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:55.929 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:55.916+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:56.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:56.104+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:56.949 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:56.936+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:57.149 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:57.136+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:57.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:57.984+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:58.119 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:58.108+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:58.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:58.964+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:49:59.087 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:49:59.076+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:49:59.994 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:49:59.984+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:00.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:00.044+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:00.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:00.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:01.010 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:01.000+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:01.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:01.976+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:01.991 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:01.980+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:02.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:02.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:03.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:03.012+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:03.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:03.980+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:03.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:03.984+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:04.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:04.976+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:05.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:05.000+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:06.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:05.992+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:06.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:05.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:06.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:06.956+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:07.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:07.004+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:07.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:07.964+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:08.049 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:08.036+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:09.010 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:08.996+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:09.049 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:09.036+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:10.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:10.000+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:10.051 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:10.040+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:10.969 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:10.956+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:11.094 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:11.084+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:11.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:11.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:12.093 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:12.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:12.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:12.904+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:13.141 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:13.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:13.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:13.952+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:14.098 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:14.084+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:15.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:15.004+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:15.113 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:15.100+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:15.984 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:15.972+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:16.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:16.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:16.939 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:16.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:17.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:17.092+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:17.971 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:17.960+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:18.145 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:18.132+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:18.936 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:18.924+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:19.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:19.092+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:19.892 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:19.880+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:20.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:20.140+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:20.879 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:20.868+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:21.142 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:21.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:21.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:21.892+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:22.131 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:22.120+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:22.902 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:22.892+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:23.108 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:23.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:23.886 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:23.876+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:24.067 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:24.056+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:24.885 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:24.872+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:25.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:25.048+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:25.918 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:25.908+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:26.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:26.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:26.942 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:26.932+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:27.067 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:27.056+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:27.986 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:27.976+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:28.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:28.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:28.950 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:28.940+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:29.090 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:29.076+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:29.971 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:29.960+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:30.082 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:30.072+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:30.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:30.960+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:31.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:31.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:31.952 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:31.940+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:32.046 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:32.036+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:32.952 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:32.940+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:33.060 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:33.048+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:33.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:33.952+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:34.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:34.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:34.971 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:34.960+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:35.083 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:35.072+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:35.993 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:35.980+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:36.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:36.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:36.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:36.968+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:37.154 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:37.144+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:38.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:38.004+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:38.148 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:38.136+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:39.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:38.996+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:39.134 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:39.124+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:39.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:39.968+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:40.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:40.116+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:40.933 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:40.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:41.170 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:41.156+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:41.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:41.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:42.175 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:42.164+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:42.900 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:42.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:43.204 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:43.192+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:43.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:43.871+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:44.181 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:44.167+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:44.889 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:44.875+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:45.170 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:45.159+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:45.859 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:45.847+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:46.134 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:46.119+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:46.890 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:46.875+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:47.168 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:47.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:47.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:47.883+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:48.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:48.115+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:48.942 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:48.931+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:49.129 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:49.115+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:49.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:49.895+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:50.142 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:50.127+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:50.923 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:50.911+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:51.094 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:51.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:51.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:51.923+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:52.097 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:52.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:52.909 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:52.895+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:53.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:53.091+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:53.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:53.903+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:54.082 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:54.071+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:54.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:54.883+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:55.036 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:55.023+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:55.886 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:55.875+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:56.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:55.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:56.880 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:56.867+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:57.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:57.003+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:57.907 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:57.895+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:57.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:57.967+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:58.872 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:58.859+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:59.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:58.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:50:59.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:50:59.895+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:50:59.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:50:59.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:00.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:00.919+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:00.971 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:00.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:01.888 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:01.875+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:01.944 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:01.931+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:02.865 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:02.851+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:02.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:02.951+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:03.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:03.839+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:03.976 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:03.963+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:04.880 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:04.867+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:04.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:04.955+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:05.887 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:05.875+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:05.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:05.955+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:06.874 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:06.863+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:06.929 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:06.915+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:07.872 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:07.859+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:07.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:07.963+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:08.844 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:08.831+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:08.966 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:08.951+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:09.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:09.799+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:09.943 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:09.931+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:10.847 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:10.835+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:10.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:10.883+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:11.889 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:11.875+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:11.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:11.923+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:12.877 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:12.863+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:12.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:12.963+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:13.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:13.903+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:13.960 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:13.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:14.962 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:14.951+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:15.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:14.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:15.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:15.951+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:15.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:15.955+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:16.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:16.931+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:16.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:16.939+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:17.902 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:17.891+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:17.924 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:17.911+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:18.868 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:18.855+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:18.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:18.931+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:19.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:19.835+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:19.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:19.967+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:20.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:20.839+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:20.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:20.935+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:21.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:21.803+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:22.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:21.987+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:22.863 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:22.851+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:23.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:23.003+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:23.839 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:23.827+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:24.052 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:24.039+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:24.889 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:24.875+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:25.050 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:25.039+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:25.904 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:25.891+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:26.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:26.011+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:26.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:26.879+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:27.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:27.047+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:27.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:27.931+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:28.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:28.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:28.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:28.947+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:29.042 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:29.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:29.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:29.915+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:30.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:29.995+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:30.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:30.943+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:30.995 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:30.983+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:31.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:31.951+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:31.986 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:31.971+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:32.999 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:32.987+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:33.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:32.999+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:33.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:33.963+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:34.045 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:34.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:34.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:34.947+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:35.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:35.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:35.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:35.903+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:36.079 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:36.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:36.900 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:36.887+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:37.032 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:37.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:37.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:37.883+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:38.005 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:37.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:38.868 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:38.855+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:39.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:39.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:39.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:39.839+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:40.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:40.079+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:40.847 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:40.835+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:41.132 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:41.119+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:41.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:41.839+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:42.134 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:42.123+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:42.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:42.815+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:43.135 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:43.123+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:43.821 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:43.807+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:44.142 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:44.131+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:44.792 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:44.779+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:45.190 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:45.179+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:45.842 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:45.831+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:46.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:46.183+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:46.860 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:46.847+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:47.167 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:47.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:47.904 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:47.891+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:48.150 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:48.139+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:48.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:48.907+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:49.173 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:49.159+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:49.946 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:49.935+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:50.219 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:50.207+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:50.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:50.931+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:51.180 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:51.167+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:51.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:51.959+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:52.143 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:52.131+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:53.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:53.007+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:53.098 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:53.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:54.023 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:54.011+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:54.090 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:54.079+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:55.048 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:55.035+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:55.082 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:55.071+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:56.021 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:56.007+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:56.051 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:56.039+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:57.010 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:56.999+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:57.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:57.055+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:58.025 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:58.011+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:58.048 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:58.035+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:59.010 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:58.999+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:51:59.033 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:51:59.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:51:59.962 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:51:59.947+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:00.028 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:00.015+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:00.993 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:00.979+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:01.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:01.003+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:01.984 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:01.971+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:02.046 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:02.035+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:03.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:02.999+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:03.080 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:03.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:03.985 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:03.971+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:04.115 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:04.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:05.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:05.011+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:05.123 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:05.111+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:06.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:05.987+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:06.144 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:06.131+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:07.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:07.007+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:07.173 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:07.159+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:08.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:07.991+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:08.203 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:08.191+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:08.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:08.947+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:09.174 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:09.163+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:09.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:09.943+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:10.169 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:10.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:10.983 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:10.971+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:11.216 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:11.203+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:11.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:11.967+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:12.211 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:12.199+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:12.941 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:12.927+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:13.179 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:13.167+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:13.912 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:13.899+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:14.143 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:14.131+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:14.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:14.891+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:15.149 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:15.135+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:15.933 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:15.919+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:16.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:16.183+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:16.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:16.963+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:17.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:17.139+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:17.947 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:17.935+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:18.148 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:18.135+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:18.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:18.931+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:19.179 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:19.167+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:19.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:19.919+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:20.215 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:20.203+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:20.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:20.947+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:21.218 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:21.207+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:21.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:21.967+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:22.232 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:22.219+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:22.993 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:22.979+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:23.257 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:23.243+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:23.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:23.959+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:24.253 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:24.239+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:24.946 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:24.935+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:25.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:25.211+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:25.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:25.951+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:26.217 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:26.203+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:26.918 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:26.907+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:27.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:27.211+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:27.923 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:27.911+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:28.207 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:28.195+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:28.967 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:28.955+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:29.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:29.183+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:29.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:29.959+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:30.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:30.147+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:30.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:30.983+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:31.148 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:31.135+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:31.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:31.955+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:32.168 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:32.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:32.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:32.983+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:33.145 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:33.131+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:33.973 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:33.959+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:34.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:34.183+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:34.988 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:34.975+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:35.155 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:35.143+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:36.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:35.991+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:36.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:36.139+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:36.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:36.979+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:37.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:37.179+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:38.032 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:38.019+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:38.180 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:38.167+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:39.014 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:39.003+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:39.180 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:39.167+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:40.019 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:40.007+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:40.209 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:40.195+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:41.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:41.019+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:41.200 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:41.187+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:42.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:41.995+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:42.156 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:42.143+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:43.025 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:43.011+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:43.155 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:43.143+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:44.053 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:44.039+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:44.111 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:44.099+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:45.071 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:45.059+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:45.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:45.067+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:46.082 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:46.071+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:46.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:46.079+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:47.068 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:47.055+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:47.080 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:47.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:48.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:48.059+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:48.099 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:48.087+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:49.037 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:49.023+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:49.101 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:49.087+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:50.069 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:50.055+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:50.129 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:50.115+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:51.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:51.091+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:51.173 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:51.159+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:52.139 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:52.127+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:52.221 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:52.207+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:53.160 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:53.147+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:53.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:53.259+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:54.205 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:54.191+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:54.302 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:54.291+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:55.204 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:55.191+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:55.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:55.275+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:56.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:56.155+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:56.292 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:56.279+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:57.166 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:57.155+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:57.318 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:57.307+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:58.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:58.123+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:58.286 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:58.275+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:52:59.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:52:59.099+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:52:59.259 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:52:59.247+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:00.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:00.083+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:00.217 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:00.203+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:01.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:01.079+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:01.202 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:01.187+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:02.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:02.047+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:02.249 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:02.235+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:03.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:03.055+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:03.261 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:03.247+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:04.046 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:04.035+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:04.247 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:04.235+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:05.044 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:05.030+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:05.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:05.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:06.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:06.014+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:06.296 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:06.282+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:07.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:07.050+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:07.265 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:07.250+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:08.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:08.078+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:08.282 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:08.270+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:09.064 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:09.050+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:09.244 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:09.230+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:10.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:10.046+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:10.232 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:10.218+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:11.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:11.002+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:11.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:11.210+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:12.036 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:12.022+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:12.226 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:12.214+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:13.086 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:13.074+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:13.271 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:13.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:14.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:14.118+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:14.293 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:14.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:15.114 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:15.102+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:15.261 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:15.246+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:16.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:16.090+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:16.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:16.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:17.090 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:17.078+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:17.261 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:17.246+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:18.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:18.054+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:18.278 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:18.266+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:19.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:19.062+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:19.273 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:19.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:20.049 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:20.034+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:20.253 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:20.238+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:21.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:21.018+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:21.249 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:21.238+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:21.998 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:21.986+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:22.236 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:22.222+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:23.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:23.010+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:23.246 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:23.234+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:24.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:23.994+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:24.291 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:24.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:24.973 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:24.958+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:25.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:25.322+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:25.999 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:25.986+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:26.347 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:26.334+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:26.998 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:26.986+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:27.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:27.366+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:27.987 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:27.974+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:28.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:28.398+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:29.008 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:28.994+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:29.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:29.350+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:30.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:29.994+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:30.358 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:30.346+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:31.053 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:31.038+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:31.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:31.366+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:32.100 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:32.086+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:32.339 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:32.326+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:33.118 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:33.106+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:33.314 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:33.302+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:34.166 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:34.154+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:34.270 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:34.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:35.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:35.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:35.294 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:35.282+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:36.172 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:36.158+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:36.274 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:36.262+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:37.153 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:37.138+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:37.265 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:37.250+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:38.123 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:38.110+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:38.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:38.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:39.117 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:39.102+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:39.306 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:39.294+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:40.100 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:40.086+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:40.332 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:40.318+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:41.105 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:41.090+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:41.366 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:41.354+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:42.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:42.074+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:42.324 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:42.310+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:43.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:43.058+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:43.306 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:43.294+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:44.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:44.034+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:44.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:44.286+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:45.015 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:45.002+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:45.280 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:45.266+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:46.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:46.002+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:46.273 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:46.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:46.996 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:46.982+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:47.269 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:47.254+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:48.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:47.998+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:48.259 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:48.246+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:49.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:49.014+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:49.244 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:49.230+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:50.029 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:50.014+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:50.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:50.222+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:51.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:51.058+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:51.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:51.226+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:52.087 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:52.074+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:52.286 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:52.274+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:53.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:53.090+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:53.264 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:53.250+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:54.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:54.126+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:54.238 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:54.226+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:55.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:55.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:55.270 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:55.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:56.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:56.146+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:56.305 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:56.290+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:57.172 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:57.158+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:57.277 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:57.262+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:58.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:58.142+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:58.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:58.226+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:53:59.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:53:59.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:53:59.214 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:53:59.202+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:00.163 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:00.150+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:00.174 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:00.162+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:01.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:01.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:01.221 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:01.206+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:02.230 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:02.214+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:02.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:02.218+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:03.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:03.222+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:03.250 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:03.238+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:04.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:04.262+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:04.286 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:04.274+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:05.326 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:05.314+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:05.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:05.314+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:06.287 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:06.274+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:06.290 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:06.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:07.239 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:07.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:07.271 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:07.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:08.269 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:08.254+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:08.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:08.266+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:09.226 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:09.214+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:09.292 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:09.278+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:10.276 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:10.262+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:10.305 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:10.290+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:11.237 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:11.222+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:11.300 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:11.286+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:12.190 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:12.178+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:12.335 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:12.322+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:13.240 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:13.226+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:13.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:13.342+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:14.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:14.182+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:14.316 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:14.302+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:15.176 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:15.162+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:15.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:15.306+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:16.221 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:16.206+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:16.273 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:16.258+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:17.242 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:17.230+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:17.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:17.238+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:18.250 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:18.238+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:18.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:18.270+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:19.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:19.222+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:19.251 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:19.238+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:20.243 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:20.230+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:20.282 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:20.270+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:21.247 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:21.234+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:21.294 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:21.282+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:22.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:22.190+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:22.257 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:22.238+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:23.205 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:23.190+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:23.228 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:23.214+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:24.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:24.218+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:24.245 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:24.230+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:25.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:25.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:25.230 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:25.218+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:26.193 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:26.178+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:26.217 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:26.202+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:27.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:27.182+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:27.205 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:27.190+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:28.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:28.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:28.231 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:28.218+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:29.208 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:29.194+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:29.250 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:29.238+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:30.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:30.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:30.278 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:30.266+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:31.228 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:31.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:31.313 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:31.298+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:32.221 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:32.206+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:32.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:32.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:33.255 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:33.242+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:33.271 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:33.258+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:34.215 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:34.202+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:34.287 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:34.274+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:35.224 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:35.210+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:35.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:35.306+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:36.263 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:36.246+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:36.340 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:36.326+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:37.257 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:37.242+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:37.378 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:37.366+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:38.293 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:38.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:38.378 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:38.366+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:39.327 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:39.314+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:39.361 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:39.346+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:40.341 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:40.326+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:40.386 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:40.374+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:41.339 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:41.326+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:41.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:41.402+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:42.317 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:42.302+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:42.445 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:42.430+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:43.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:43.346+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:43.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:43.386+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:44.383 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:44.370+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:44.409 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:44.394+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:45.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:45.398+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:45.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:45.422+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:46.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:46.374+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:46.402 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:46.390+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:47.383 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:47.370+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:47.437 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:47.422+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:48.405 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:48.390+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:48.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:48.406+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:49.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:49.362+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:49.454 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:49.442+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:50.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:50.398+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:50.465 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:50.450+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:51.390 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:51.378+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:51.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:51.410+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:52.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:52.390+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:52.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:52.422+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:53.429 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:53.414+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:53.446 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:53.434+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:54.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:54.370+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:54.472 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:54.458+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:55.404 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:55.390+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:55.456 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:55.442+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:56.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:56.390+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:56.444 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:56.430+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:57.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:57.390+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:57.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:57.394+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:58.433 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:58.418+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:54:58.442 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:58.430+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:59.440 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:54:59.422+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:54:59.448 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:54:59.434+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:00.424 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:00.410+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:00.446 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:00.434+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:01.452 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:01.438+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:01.493 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:01.478+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:02.498 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:02.486+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:02.520 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:02.506+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:03.503 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:03.490+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:03.510 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:03.498+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:04.482 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:04.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:04.497 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:04.482+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:05.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:05.470+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:05.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:05.514+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:06.469 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:06.454+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:06.481 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:06.466+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:07.471 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:07.458+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:07.477 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:07.462+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:08.470 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:08.458+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:08.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:08.470+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:09.444 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:09.430+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:09.486 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:09.474+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:10.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:10.442+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:10.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:10.470+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:11.484 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:11.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:11.530 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:11.514+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:12.499 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:12.486+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:12.570 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:12.558+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:13.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:13.450+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:13.587 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:13.574+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:14.496 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:14.481+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:14.565 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:14.549+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:15.452 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:15.437+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:15.545 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:15.529+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:16.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:16.421+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:16.533 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:16.517+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:17.434 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:17.421+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:17.500 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:17.485+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:18.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:18.377+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:18.491 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:18.477+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:19.396 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:19.381+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:19.455 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:19.441+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:20.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:20.417+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:20.442 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:20.425+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:21.389 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:21.373+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:21.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:21.453+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:22.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:22.361+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:22.460 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:22.445+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:23.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:23.401+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:23.438 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:23.425+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:24.419 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:24.409+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:24.481 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:24.465+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:25.420 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:25.409+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:25.485 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:25.473+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:26.387 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:26.373+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:26.458 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:26.445+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:27.399 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:27.389+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:27.467 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:27.457+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:28.392 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:28.381+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:28.509 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:28.493+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:29.392 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:29.377+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:29.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:29.549+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:30.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:30.333+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:30.558 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:30.549+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:31.340 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:31.329+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:31.535 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:31.525+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:32.359 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:32.349+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:32.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:32.545+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:33.311 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:33.301+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:33.533 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:33.521+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:34.308 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:34.297+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:34.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:34.529+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:35.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:35.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:35.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:35.549+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:36.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:36.345+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:36.513 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:36.501+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:37.338 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:37.329+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:37.480 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:37.469+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:38.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:38.341+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:38.508 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:38.497+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:39.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:39.365+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:39.524 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:39.513+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:40.416 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:40.405+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:40.535 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:40.525+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:41.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:41.365+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:41.510 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:41.497+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:42.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:42.341+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:42.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:42.517+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:43.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:43.301+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:43.547 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:43.537+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:44.322 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:44.313+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:44.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:44.565+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:45.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:45.285+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:45.562 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:45.553+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:46.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:46.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:46.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:46.549+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:47.340 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:47.329+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:47.527 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:47.517+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:48.305 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:48.293+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:48.536 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:48.525+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:49.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:49.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:49.585 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:49.573+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:50.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:50.341+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:50.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:50.549+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:51.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:51.361+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:51.544 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:51.533+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:52.367 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:52.357+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:52.564 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:52.553+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:53.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:53.341+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:53.573 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:53.561+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:54.352 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:54.341+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:54.532 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:54.521+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:55.339 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:55.329+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:55.509 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:55.497+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:56.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:56.285+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:56.545 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:56.533+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:57.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:57.317+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:57.567 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:57.557+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:58.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:58.281+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:58.541 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:58.529+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:55:59.313 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:55:59.301+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:55:59.590 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:55:59.581+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:00.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:00.321+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:00.629 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:00.617+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:01.316 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:01.305+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:01.676 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:01.665+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:02.280 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:02.269+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:02.653 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:02.641+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:03.256 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:03.245+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:03.653 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:03.641+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:04.274 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:04.265+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:04.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:04.633+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:05.314 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:05.305+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:05.627 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:05.617+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:06.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:06.261+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:06.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:06.661+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:07.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:07.285+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:07.680 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:07.669+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:08.252 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:08.241+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:08.712 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:08.701+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:09.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:09.281+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:09.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:09.693+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:10.273 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:10.261+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:10.687 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:10.677+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:11.302 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:11.293+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:11.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:11.693+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:12.283 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:12.273+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:12.744 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:12.733+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:13.324 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:13.313+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:13.768 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:13.757+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:14.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:14.293+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:14.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:14.721+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:15.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:15.337+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:15.780 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:15.769+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:16.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:16.381+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:16.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:16.785+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:17.408 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:17.397+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:17.833 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:17.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:18.367 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:18.357+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:18.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:18.873+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:19.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:19.345+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:19.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:19.881+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:20.352 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:20.341+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:20.941 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:20.929+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:21.327 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:21.317+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:21.984 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:21.973+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:22.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:22.365+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:23.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:23.005+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:23.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:23.361+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:24.031 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:24.021+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:24.402 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:24.393+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:25.064 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:25.053+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:25.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:25.365+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:26.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:26.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:26.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:26.393+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:27.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:27.109+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:27.399 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:27.389+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:28.140 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:28.129+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:28.358 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:28.349+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:29.094 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:29.085+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:29.367 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:29.357+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:30.095 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:30.085+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:30.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:30.369+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:31.119 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:31.109+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:31.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:31.341+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:32.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:32.077+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:32.328 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:32.317+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:33.067 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:33.057+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:33.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:33.337+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:34.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:34.049+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:34.396 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:34.385+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:35.065 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:35.053+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:35.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:35.433+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:36.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:36.093+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:36.428 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:36.417+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:37.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:37.045+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:37.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:37.385+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:38.095 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:38.085+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:38.446 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:38.437+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:39.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:39.101+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:39.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:39.477+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:40.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:40.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:40.454 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:40.445+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:41.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:41.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:41.439 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:41.429+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:42.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:42.185+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:42.490 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:42.481+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:43.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:43.181+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:43.475 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:43.465+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:44.182 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:44.169+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:44.511 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:44.501+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:45.147 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:45.137+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:45.488 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:45.477+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:46.155 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:46.145+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:46.499 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:46.489+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:47.107 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:47.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:47.455 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:47.445+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:48.144 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:48.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:48.463 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:48.453+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:49.123 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:49.113+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:49.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:49.425+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:50.094 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:50.085+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:50.427 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:50.417+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:51.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:51.061+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:51.447 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:51.437+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:52.031 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:52.021+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:52.460 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:52.449+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:53.081 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:53.069+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:53.490 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:53.481+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:54.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:54.109+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:54.537 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:54.525+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:55.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:55.117+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:55.530 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:55.521+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:56.133 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:56.121+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:56.498 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:56.489+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:57.116 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:57.105+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:57.516 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:57.505+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:58.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:58.073+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:58.491 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:58.481+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:56:59.071 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:56:59.061+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:56:59.514 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:56:59.505+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:00.121 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:00.109+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:00.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:00.517+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:01.159 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:01.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:01.555 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:01.545+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:02.140 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:02.129+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:02.584 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:02.573+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:03.144 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:03.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:03.575 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:03.565+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:04.108 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:04.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:04.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:04.593+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:05.075 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:05.065+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:05.649 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:05.637+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:06.031 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:06.021+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:06.606 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:06.597+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:07.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:07.017+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:07.618 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:07.609+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:07.980 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:07.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:08.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:08.605+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:08.978 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:08.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:09.659 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:09.649+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:09.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:09.949+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:10.649 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:10.637+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:10.926 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:10.917+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:11.628 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:11.617+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:11.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:11.873+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:12.646 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:12.637+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:12.888 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:12.877+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:13.625 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:13.613+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:13.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:13.921+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:14.661 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:14.649+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:14.924 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:14.913+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:15.695 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:15.685+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:15.909 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:15.897+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:16.721 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:16.708+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:16.960 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:16.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:17.766 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:17.756+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:17.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:17.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:18.772 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:18.760+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:18.923 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:18.912+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:19.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:19.736+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:19.933 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:19.920+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:20.742 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:20.728+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:20.902 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:20.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:21.760 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:21.748+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:21.863 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:21.852+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:22.718 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:22.708+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:22.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:22.888+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:23.768 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:23.756+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:23.889 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:23.876+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:24.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:24.728+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:24.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:24.836+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:25.727 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:25.716+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:25.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:25.792+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:26.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:26.728+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:26.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:26.788+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:27.696 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:27.684+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:27.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:27.836+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:28.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:28.728+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:28.881 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:28.868+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:29.721 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:29.708+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:29.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:29.860+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:30.719 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:30.708+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:30.829 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:30.816+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:31.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:31.724+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:31.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:31.804+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:32.781 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:32.768+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:32.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:32.772+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:33.818 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:33.808+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:33.820 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:33.808+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:34.829 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:34.816+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:34.836 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:34.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:35.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:35.780+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:35.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:35.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:36.787 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:36.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:36.857 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:36.844+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:37.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:37.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:37.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:37.864+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:38.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:38.816+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:38.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:38.864+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:39.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:39.812+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:39.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:39.864+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:40.842 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:40.832+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:40.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:40.836+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:41.828 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:41.816+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:41.865 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:41.852+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:42.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:42.772+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:42.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:42.816+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:43.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:43.748+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:43.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:43.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:44.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:44.796+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:44.823 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:44.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:45.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:45.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:45.809 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:45.796+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:46.770 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:46.760+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:46.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:46.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:47.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:47.744+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:47.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:47.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:48.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:48.712+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:48.870 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:48.860+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:49.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:49.764+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:49.866 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:49.856+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:50.744 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:50.732+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:50.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:50.816+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:51.729 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:51.716+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:51.848 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:51.836+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:52.772 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:52.760+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:52.888 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:52.876+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:53.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:53.756+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:53.939 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:53.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:54.742 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:54.732+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:54.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:54.940+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:55.767 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:55.756+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:55.907 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:55.896+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:56.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:56.804+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:56.864 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:56.852+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:57.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:57.840+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:57.860 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:57.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:58.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:58.796+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:58.844 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:58.832+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:57:59.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:57:59.764+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:57:59.823 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:57:59.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:00.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:00.772+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:00.872 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:00.860+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:01.744 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:01.732+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:01.843 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:01.832+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:02.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:02.772+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:02.855 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:02.844+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:03.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:03.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:03.868 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:03.856+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:04.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:04.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:04.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:04.900+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:05.843 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:05.832+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:05.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:05.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:06.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:06.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:06.937 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:06.924+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:07.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:07.828+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:07.946 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:07.936+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:08.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:08.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:08.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:08.952+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:09.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:09.780+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:09.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:09.964+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:10.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:10.756+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:11.012 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:11.000+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:11.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:11.724+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:12.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:12.000+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:12.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:12.764+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:12.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:12.956+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:13.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:13.780+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:13.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:13.956+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:14.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:14.812+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:15.014 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:15.004+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:15.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:15.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:15.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:15.972+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:16.783 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:16.772+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:16.974 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:16.964+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:17.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:17.752+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:18.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:17.988+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:18.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:18.736+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:18.989 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:18.976+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:19.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:19.692+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:20.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:20.008+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:20.688 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:20.676+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:20.980 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:20.968+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:21.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:21.708+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:22.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:22.016+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:22.671 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:22.660+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:23.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:23.052+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:23.695 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:23.684+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:24.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:24.072+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:24.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:24.712+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:25.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:25.092+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:25.724 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:25.712+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:26.148 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:26.136+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:26.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:26.736+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:27.113 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:27.100+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:27.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:27.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:28.145 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:28.132+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:28.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:28.820+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:29.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:29.176+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:29.875 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:29.864+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:30.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:30.200+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:30.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:30.860+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:31.167 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:31.156+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:31.862 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:31.852+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:32.129 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:32.116+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:32.905 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:32.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:33.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:33.124+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:33.912 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:33.900+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:34.167 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:34.156+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:34.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:34.936+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:35.187 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:35.176+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:35.986 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:35.976+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:36.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:36.208+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:37.010 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:37.000+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:37.245 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:37.232+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:37.966 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:37.956+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:38.201 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:38.188+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:38.980 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:38.968+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:39.226 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:39.216+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:40.023 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:40.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:40.214 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:40.204+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:41.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:41.000+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:41.229 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:41.216+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:42.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:41.988+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:42.229 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:42.216+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:43.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:43.004+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:43.246 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:43.236+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:44.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:44.000+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:44.283 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:44.272+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:44.983 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:44.972+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:45.267 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:45.256+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:45.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:45.936+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:46.229 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:46.216+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:46.923 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:46.912+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:47.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:47.244+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:47.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:47.940+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:48.234 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:48.224+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:48.921 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:48.908+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:49.217 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:49.204+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:49.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:49.936+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:50.260 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:50.248+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:50.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:50.908+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:51.307 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:51.296+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:51.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:51.872+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:52.280 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:52.268+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:52.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:52.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:53.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:53.272+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:53.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:53.848+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:54.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:54.296+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:54.857 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:54.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:55.343 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:55.332+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:55.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:55.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:56.361 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:56.348+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:56.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:56.808+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:57.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:57.392+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:57.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:57.780+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:58.446 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:58.436+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:58.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:58.736+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:58:59.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:58:59.460+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:58:59.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:58:59.716+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:00.433 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:00.420+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:00.743 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:00.732+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:01.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:01.424+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:01.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:01.704+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:02.433 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:02.420+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:02.724 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:02.712+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:03.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:03.424+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:03.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:03.700+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:04.396 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:04.384+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:04.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:04.656+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:05.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:05.420+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:05.655 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:05.644+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:06.407 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:06.396+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:06.621 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:06.608+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:07.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:07.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:07.615 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:07.604+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:08.428 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:08.416+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:08.606 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:08.596+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:09.478 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:09.468+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:09.592 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:09.580+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:10.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:10.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:10.595 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:10.584+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:11.469 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:11.456+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:11.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:11.624+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:12.502 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:12.492+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:12.640 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:12.628+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:13.507 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:13.495+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:13.609 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:13.595+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:14.466 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:14.455+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:14.659 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:14.647+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:15.427 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:15.415+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:15.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:15.643+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:16.445 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:16.431+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:16.621 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:16.607+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:17.444 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:17.431+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:17.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:17.591+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:18.484 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:18.471+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:18.590 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:18.579+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:19.496 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:19.483+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:19.596 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:19.583+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:20.507 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:20.495+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:20.597 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:20.583+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:21.471 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:21.459+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:21.611 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:21.599+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:22.500 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:22.487+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:22.572 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:22.559+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:23.457 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:23.443+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:23.582 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:23.571+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:24.458 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:24.447+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:24.629 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:24.615+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:25.460 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:25.447+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:25.618 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:25.607+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:26.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:26.427+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:26.580 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:26.567+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:27.439 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:27.427+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:27.552 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:27.539+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:28.427 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:28.415+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:28.527 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:28.515+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:29.471 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:29.459+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:29.495 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:29.483+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:30.462 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:30.451+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:30.522 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:30.511+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:31.455 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:31.443+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:31.530 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:31.519+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:32.474 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:32.463+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:32.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:32.527+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:33.439 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:33.427+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:33.574 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:33.563+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:34.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:34.387+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:34.587 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:34.575+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:35.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:35.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:35.606 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:35.595+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:36.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:36.319+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:36.643 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:36.631+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:37.308 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:37.295+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:37.668 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:37.655+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:38.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:38.295+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:38.657 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:38.643+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:39.267 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:39.255+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:39.680 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:39.667+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:40.293 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:40.279+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:40.699 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:40.687+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:41.307 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:41.295+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:41.680 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:41.667+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:42.321 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:42.307+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:42.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:42.655+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:43.341 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:43.327+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:43.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:43.695+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:44.330 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:44.319+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:44.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:44.655+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:45.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:45.335+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:45.640 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:45.627+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:46.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:46.303+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:46.661 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:46.647+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:47.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:47.335+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:47.651 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:47.639+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:48.301 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:48.287+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:48.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:48.619+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:49.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:49.291+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:49.612 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:49.599+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:50.311 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:50.299+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:50.642 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:50.631+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:51.341 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:51.327+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:51.622 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:51.611+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:52.308 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:52.295+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:52.612 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:52.599+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:53.337 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:53.323+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:53.655 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:53.643+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:54.304 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:54.291+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:54.610 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:54.599+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:55.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:55.307+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:55.586 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:55.575+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:56.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:56.271+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:56.613 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:56.599+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:57.294 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:57.283+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:57.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:57.563+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:58.248 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:58.235+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:58.557 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:58.543+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T02:59:59.229 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T02:59:59.215+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T02:59:59.518 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T02:59:59.507+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:00.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:00.175+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:00.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:00.547+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:01.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:01.199+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:01.529 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:01.515+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:02.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:02.183+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:02.489 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:02.475+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:03.190 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:03.179+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:03.501 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:03.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:04.215 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:04.203+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:04.538 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:04.527+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:05.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:05.251+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:05.583 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:05.571+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:06.304 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:06.291+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:06.603 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:06.591+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:07.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:07.247+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:07.569 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:07.555+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:08.218 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:08.207+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:08.600 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:08.587+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:09.241 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:09.227+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:09.621 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:09.607+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:10.213 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:10.199+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:10.604 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:10.591+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:11.200 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:11.187+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:11.580 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:11.567+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:12.238 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:12.227+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:12.551 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:12.539+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:13.238 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:13.227+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:13.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:13.547+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:14.289 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:14.275+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:14.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:14.547+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:15.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:15.227+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:15.513 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:15.499+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:16.280 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:16.267+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:16.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:16.451+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:17.293 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:17.279+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:17.497 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:17.483+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:18.341 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:18.327+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:18.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:18.455+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:19.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:19.363+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:19.498 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:19.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:20.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:20.363+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:20.529 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:20.515+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:21.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:21.363+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:21.577 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:21.563+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:22.386 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:22.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:22.562 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:22.551+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:23.398 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:23.387+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:23.533 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:23.519+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:24.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:24.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:24.504 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:24.491+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:25.399 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:25.387+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:25.540 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:25.527+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:26.352 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:26.339+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:26.588 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:26.575+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:27.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:27.295+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:27.587 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:27.575+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:28.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:28.339+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:28.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:28.543+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:29.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:29.359+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:29.564 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:29.551+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:30.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:30.319+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:30.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:30.523+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:31.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:31.303+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:31.557 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:31.543+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:32.313 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:32.299+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:32.562 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:32.551+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:33.324 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:33.311+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:33.573 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:33.559+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:34.366 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:34.355+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:34.591 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:34.579+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:35.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:35.371+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:35.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:35.563+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:36.396 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:36.383+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:36.540 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:36.527+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:37.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:37.343+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:37.521 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:37.507+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:38.365 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:38.351+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:38.511 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:38.499+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:39.405 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:39.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:39.529 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:39.515+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:40.381 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:40.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:40.493 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:40.479+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:41.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:41.371+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:41.493 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:41.479+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:42.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:42.371+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:42.455 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:42.443+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:43.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:43.351+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:43.425 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:43.411+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:44.326 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:44.315+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:44.431 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:44.419+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:45.341 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:45.327+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:45.428 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:45.415+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:46.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:46.307+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:46.410 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:46.399+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:47.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:47.335+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:47.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:47.351+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:48.333 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:48.319+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:48.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:48.323+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:49.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:49.275+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:49.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:49.319+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:50.294 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:50.283+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:50.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:50.371+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:51.325 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:51.311+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:51.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:51.339+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:52.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:52.319+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:52.368 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:52.355+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:53.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:53.291+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:53.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:53.343+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:54.297 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:54.283+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:54.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:54.351+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:55.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:55.263+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:55.316 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:55.303+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:56.300 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:56.287+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:56.326 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:56.315+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:57.349 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:57.335+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:57.374 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:57.363+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:58.354 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:58.343+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:58.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:58.387+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:00:59.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:00:59.335+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:00:59.416 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:00:59.403+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:00.366 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:00.355+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:00.435 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:00.423+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:01.404 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:01.391+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:01.408 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:01.395+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:02.386 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:02.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:02.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:02.399+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:03.340 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:03.327+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:03.395 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:03.379+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:04.375 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:04.363+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:04.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:04.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:05.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:05.322+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:05.396 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:05.382+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:06.325 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:06.310+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:06.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:06.374+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:07.305 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:07.290+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:07.383 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:07.370+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:08.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:08.306+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:08.365 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:08.350+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:09.290 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:09.278+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:09.354 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:09.342+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:10.247 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:10.234+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:10.397 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:10.382+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:11.201 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:11.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:11.372 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:11.358+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:12.209 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:12.194+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:12.403 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:12.390+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:13.204 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:13.190+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:13.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:13.346+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:14.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:14.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:14.370 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:14.358+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:15.222 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:15.210+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:15.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:15.366+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:16.226 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:16.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:16.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:16.390+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:17.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:17.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:17.399 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:17.386+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:18.227 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:18.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:18.361 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:18.346+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:19.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:19.182+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:19.397 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:19.382+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:20.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:20.166+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:20.410 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:20.398+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:21.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:21.198+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:21.429 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:21.414+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:22.202 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:22.190+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:22.425 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:22.410+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:23.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:23.230+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:23.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:23.450+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:24.243 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:24.230+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:24.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:24.450+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:25.258 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:25.246+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:25.482 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:25.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:26.300 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:26.286+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:26.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:26.454+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:27.301 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:27.286+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:27.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:27.462+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:28.313 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:28.298+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:28.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:28.438+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:29.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:29.322+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:29.419 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:29.406+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:30.292 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:30.278+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:30.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:30.454+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:31.249 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:31.234+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:31.504 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:31.490+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:32.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:32.198+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:32.524 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:32.510+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:33.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:33.150+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:33.543 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:33.530+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:34.187 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:34.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:34.495 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:34.482+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:35.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:35.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:35.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:35.514+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:36.153 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:36.138+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:36.496 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:36.482+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:37.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:37.166+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:37.455 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:37.442+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:38.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:38.166+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:38.431 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:38.418+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:39.149 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:39.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:39.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:39.450+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:40.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:40.150+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:40.509 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:40.494+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:41.149 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:41.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:41.476 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:41.462+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:42.190 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:42.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:42.432 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:42.418+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:43.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:43.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:43.449 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:43.434+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:44.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:44.206+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:44.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:44.422+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:45.172 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:45.158+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:45.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:45.378+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:46.149 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:46.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:46.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:46.406+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:47.127 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:47.114+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:47.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:47.450+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:48.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:48.146+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:48.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:48.494+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:49.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:49.122+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:49.499 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:49.486+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:50.177 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:50.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:50.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:50.530+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:51.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:51.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:51.593 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:51.578+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:52.219 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:52.206+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:52.571 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:52.558+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:53.193 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:53.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:53.531 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:53.518+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:54.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:54.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:54.498 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:54.486+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:55.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:55.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:55.513 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:55.498+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:56.153 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:56.138+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:56.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:56.546+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:57.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:57.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:57.607 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:57.594+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:58.153 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:58.138+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:58.589 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:58.574+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:01:59.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:01:59.146+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:01:59.541 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:01:59.526+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:00.196 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:00.182+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:00.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:00.510+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:01.166 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:01.154+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:01.524 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:01.510+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:02.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:02.182+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:02.541 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:02.526+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:03.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:03.222+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:03.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:03.546+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:04.271 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:04.258+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:04.544 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:04.530+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:05.316 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:05.302+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:05.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:05.546+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:06.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:06.282+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:06.583 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:06.570+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:07.282 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:07.270+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:07.580 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:07.566+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:08.330 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:08.318+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:08.567 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:08.554+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:09.354 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:09.342+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:09.541 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:09.526+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:10.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:10.370+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:10.582 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:10.570+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:11.349 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:11.334+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:11.583 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:11.570+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:12.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:12.362+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:12.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:12.618+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:13.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:13.386+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:13.655 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:13.642+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:14.416 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:14.402+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:14.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:14.614+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:15.456 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:15.442+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:15.581 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:15.566+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:16.431 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:16.418+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:16.598 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:16.586+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:17.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:17.402+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:17.622 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:17.610+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:18.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:18.370+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:18.651 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:18.638+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:19.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:19.378+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:19.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:19.614+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:20.399 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:20.386+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:20.640 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:20.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:21.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:21.370+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:21.681 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:21.666+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:22.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:22.334+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:22.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:22.670+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:23.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:23.358+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:23.649 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:23.634+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:24.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:24.314+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:24.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:24.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:25.304 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:25.290+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:25.688 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:25.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:26.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:26.334+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:26.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:26.690+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:27.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:27.382+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:27.665 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:27.650+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:28.428 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:28.414+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:28.664 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:28.650+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:29.414 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:29.402+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:29.678 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:29.666+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:30.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:30.446+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:30.641 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:30.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:31.492 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:31.478+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:31.652 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:31.638+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:32.504 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:32.490+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:32.693 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:32.678+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:33.468 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:33.454+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:33.687 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:33.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:34.440 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:34.426+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:34.680 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:34.666+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:35.490 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:35.478+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:35.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:35.658+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:36.489 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:36.474+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:36.690 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:36.678+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:37.496 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:37.482+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:37.691 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:37.678+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:38.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:38.534+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:38.672 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:38.658+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:39.575 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:39.562+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:39.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:39.662+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:40.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:40.554+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:40.682 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:40.670+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:41.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:41.534+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:41.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:41.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:42.595 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:42.582+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:42.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:42.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:43.565 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:43.550+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:43.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:43.734+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:44.549 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:44.534+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:44.734 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:44.722+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:45.537 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:45.522+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:45.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:45.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:46.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:46.506+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:46.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:46.690+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:47.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:47.526+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:47.695 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:47.682+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:48.542 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:48.530+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:48.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:48.658+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:49.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:49.514+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:49.635 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:49.622+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:50.579 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:50.566+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:50.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:50.642+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:51.613 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:51.598+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:51.640 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:51.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:52.569 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:52.554+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:52.650 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:52.638+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:53.613 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:53.597+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:53.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:53.665+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:54.621 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:54.605+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:54.686 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:54.673+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:55.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:55.589+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:55.662 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:55.649+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:56.575 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:56.561+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:56.665 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:56.649+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:57.545 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:57.529+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:57.636 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:57.621+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:58.570 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:58.557+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:58.650 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:58.633+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:02:59.561 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:02:59.545+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:02:59.691 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:02:59.677+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:00.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:00.529+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:00.663 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:00.649+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:01.551 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:01.537+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:01.621 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:01.605+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:02.553 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:02.541+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:02.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:02.613+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:03.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:03.505+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:03.621 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:03.609+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:04.549 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:04.533+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:04.627 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:04.613+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:05.526 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:05.513+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:05.655 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:05.645+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:06.545 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:06.533+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:06.658 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:06.645+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:07.540 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:07.529+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:07.618 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:07.609+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:08.532 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:08.521+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:08.604 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:08.593+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:09.543 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:09.533+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:09.563 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:09.553+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:10.541 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:10.529+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:10.549 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:10.537+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:11.501 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:11.489+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:11.564 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:11.553+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:12.471 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:12.461+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:12.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:12.545+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:13.471 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:13.461+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:13.588 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:13.577+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:14.497 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:14.485+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:14.633 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:14.621+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:15.544 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:15.533+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:15.659 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:15.649+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:16.559 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:16.549+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:16.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:16.645+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:17.557 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:17.545+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:17.654 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:17.645+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:18.558 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:18.545+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:18.692 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:18.681+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:19.560 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:19.549+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:19.742 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:19.733+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:20.598 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:20.589+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:20.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:20.721+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:21.629 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:21.617+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:21.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:21.685+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:22.652 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:22.641+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:22.659 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:22.649+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:23.620 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:23.609+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:23.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:23.657+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:24.595 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:24.585+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:24.621 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:24.609+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:25.583 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:25.573+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:25.595 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:25.585+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:26.535 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:26.525+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:26.590 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:26.581+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:27.542 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:27.533+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:27.572 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:27.561+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:28.555 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:28.545+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:28.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:28.553+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:29.530 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:29.521+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:29.533 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:29.521+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:30.555 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:30.545+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:30.578 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:30.569+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:31.540 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:31.529+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:31.574 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:31.565+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:32.519 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:32.509+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:32.583 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:32.573+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:33.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:33.465+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:33.606 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:33.597+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:34.476 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:34.465+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:34.625 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:34.613+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:35.431 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:35.421+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:35.613 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:35.601+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:36.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:36.377+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:36.609 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:36.597+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:37.400 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:37.385+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:37.602 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:37.593+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:38.395 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:38.385+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:38.563 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:38.553+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:39.415 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:39.405+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:39.584 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:39.573+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:40.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:40.389+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:40.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:40.581+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:41.375 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:41.365+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:41.613 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:41.601+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:42.410 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:42.401+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:42.645 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:42.633+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:43.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:43.353+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:43.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:43.677+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:44.410 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:44.401+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:44.641 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:44.629+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:45.376 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:45.365+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:45.627 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:45.617+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:46.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:46.393+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:46.602 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:46.593+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:47.357 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:47.345+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:47.634 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:47.625+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:48.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:48.353+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:48.661 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:48.649+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:49.394 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:49.385+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:49.639 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:49.629+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:50.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:50.369+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:50.619 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:50.609+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:51.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:51.401+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:51.636 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:51.625+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:52.413 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:52.401+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:52.659 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:52.649+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:53.404 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:53.393+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:53.620 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:53.609+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:54.389 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:54.377+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:54.612 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:54.601+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:55.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:55.377+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:55.578 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:55.565+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:56.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:56.409+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:56.574 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:56.561+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:57.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:57.393+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:57.531 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:57.521+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:58.418 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:58.409+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:58.529 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:58.517+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:03:59.389 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:03:59.377+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:03:59.546 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:03:59.533+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:00.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:00.389+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:00.530 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:00.517+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:01.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:01.373+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:01.501 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:01.489+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:02.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:02.345+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:02.490 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:02.477+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:03.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:03.361+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:03.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:03.517+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:04.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:04.353+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:04.567 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:04.557+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:05.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:05.333+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:05.588 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:05.577+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:06.322 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:06.313+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:06.579 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:06.569+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:07.351 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:07.341+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:07.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:07.605+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:08.377 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:08.365+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:08.657 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:08.645+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:09.398 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:09.389+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:09.629 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:09.617+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:10.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:10.393+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:10.584 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:10.573+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:11.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:11.393+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:11.594 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:11.581+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:12.360 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:12.349+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:12.545 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:12.533+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:13.341 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:13.329+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:13.588 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:13.577+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:14.340 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:14.329+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:14.563 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:14.553+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:15.372 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:15.361+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:15.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:15.581+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:16.383 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:16.373+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:16.588 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:16.577+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:17.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:17.325+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:17.579 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:17.569+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:18.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:18.369+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:18.574 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:18.565+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:19.419 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:19.409+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:19.579 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:19.569+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:20.426 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:20.417+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:20.608 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:20.597+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:21.396 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:21.385+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:21.631 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:21.621+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:22.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:22.429+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:22.672 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:22.661+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:23.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:23.401+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:23.655 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:23.645+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:24.459 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:24.449+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:24.653 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:24.641+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:25.446 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:25.433+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:25.703 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:25.693+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:26.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:26.389+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:26.751 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:26.741+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:27.380 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:27.369+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:27.725 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:27.713+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:28.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:28.325+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:28.743 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:28.733+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:29.343 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:29.333+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:29.780 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:29.769+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:30.326 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:30.317+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:30.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:30.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:31.312 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:31.301+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:31.797 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:31.785+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:32.316 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:32.305+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:32.770 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:32.757+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:33.323 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:33.313+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:33.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:33.801+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:34.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:34.361+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:34.861 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:34.849+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:35.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:35.333+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:35.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:35.809+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:36.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:36.369+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:36.870 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:36.861+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:37.374 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:37.365+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:37.865 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:37.853+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:38.342 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:38.332+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:38.842 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:38.832+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:39.334 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:39.320+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:39.862 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:39.852+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:40.287 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:40.276+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:40.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:40.900+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:41.275 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:41.264+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:41.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:41.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:42.244 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:42.232+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:42.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:42.912+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:43.209 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:43.196+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:43.954 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:43.944+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:44.252 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:44.240+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:44.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:44.952+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:45.280 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:45.268+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:45.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:45.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:46.269 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:46.256+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:46.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:46.944+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:47.251 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:47.240+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:47.967 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:47.956+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:48.299 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:48.288+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:48.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:48.932+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:49.283 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:49.272+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:49.988 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:49.976+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:50.295 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:50.284+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:51.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:50.996+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:51.276 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:51.264+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:52.014 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:52.004+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:52.292 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:52.280+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:53.008 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:52.996+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:53.280 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:53.268+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:54.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:53.996+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:54.261 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:54.248+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:55.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:55.016+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:55.220 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:55.208+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:56.032 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:56.020+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:56.266 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:56.256+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:57.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:56.988+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:57.280 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:57.268+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:57.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:57.952+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:58.239 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:58.228+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:58.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:58.944+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:04:59.265 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:04:59.252+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:04:59.911 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:04:59.900+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:00.283 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:00.272+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:00.891 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:00.880+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:01.325 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:01.312+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:01.905 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:01.892+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:02.332 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:02.320+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:02.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:02.936+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:03.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:03.352+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:03.951 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:03.940+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:04.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:04.368+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:04.942 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:04.932+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:05.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:05.344+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:05.986 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:05.976+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:06.327 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:06.316+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:06.981 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:06.968+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:07.358 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:07.348+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:07.999 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:07.988+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:08.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:08.392+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:08.962 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:08.952+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:09.399 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:09.388+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:09.974 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:09.964+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:10.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:10.428+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:10.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:10.960+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:11.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:11.452+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:12.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:11.992+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:12.506 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:12.496+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:12.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:12.960+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:13.486 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:13.476+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:13.942 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:13.932+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:14.524 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:14.512+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:14.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:14.952+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:15.520 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:15.508+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:15.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:15.948+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:16.478 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:16.468+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:16.937 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:16.924+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:17.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:17.516+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:17.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:17.952+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:18.570 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:18.560+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:18.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:18.936+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:19.591 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:19.580+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:19.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:19.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:20.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:20.544+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:20.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:20.904+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:21.585 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:21.572+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:21.937 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:21.924+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:22.601 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:22.588+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:22.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:22.944+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:23.596 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:23.584+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:23.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:23.916+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:24.554 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:24.544+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:24.927 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:24.916+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:25.589 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:25.576+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:25.886 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:25.876+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:26.588 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:26.576+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:26.867 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:26.856+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:27.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:27.548+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:27.891 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:27.880+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:28.599 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:28.588+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:28.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:28.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:29.557 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:29.544+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:29.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:29.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:30.563 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:30.552+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:30.791 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:30.780+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:31.613 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:31.600+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:31.834 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:31.824+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:32.582 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:32.568+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:32.873 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:32.860+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:33.538 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:33.528+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:33.864 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:33.852+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:34.584 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:34.572+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:34.825 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:34.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:35.536 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:35.524+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:35.809 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:35.796+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:36.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:36.524+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:36.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:36.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:37.495 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:37.484+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:37.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:37.880+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:38.452 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:38.440+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:38.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:38.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:39.493 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:39.480+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:39.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:39.864+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:40.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:40.488+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:40.837 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:40.824+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:41.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:41.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:41.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:41.816+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:42.422 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:42.412+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:42.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:42.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:43.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:43.408+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:43.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:43.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:44.375 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:44.364+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:44.899 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:44.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:45.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:45.316+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:45.898 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:45.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:46.363 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:46.352+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:46.912 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:46.900+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:47.323 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:47.312+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:47.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:47.912+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:48.285 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:48.272+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:48.902 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:48.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:49.256 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:49.244+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:49.867 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:49.856+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:50.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:50.224+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:50.901 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:50.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:51.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:51.196+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:51.859 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:51.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:52.205 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:52.192+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:52.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:52.824+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:53.212 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:53.200+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:53.886 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:53.876+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:54.174 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:54.164+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:54.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:54.904+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:55.213 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:55.200+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:55.933 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:55.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:56.199 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:56.188+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:56.946 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:56.936+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:57.222 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:57.212+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:57.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:57.944+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:58.242 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:58.232+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:58.911 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:58.900+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:05:59.224 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:05:59.212+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:05:59.939 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:05:59.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:00.177 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:00.164+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:00.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:00.904+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:01.214 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:01.204+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:01.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:01.932+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:02.203 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:02.192+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:02.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:02.932+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:03.180 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:03.168+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:03.920 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:03.908+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:04.197 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:04.184+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:04.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:04.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:05.173 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:05.160+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:05.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:05.880+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:06.152 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:06.140+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:06.871 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:06.860+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:07.131 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:07.120+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:07.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:07.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:08.150 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:08.140+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:08.872 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:08.860+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:09.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:09.180+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:09.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:09.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:10.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:10.200+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:10.802 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:10.788+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:11.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:11.180+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:11.782 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:11.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:12.168 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:12.156+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:12.789 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:12.776+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:13.197 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:13.184+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:13.825 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:13.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:14.229 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:14.216+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:14.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:14.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:15.240 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:15.228+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:15.817 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:15.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:16.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:16.228+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:16.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:16.788+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:17.243 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:17.232+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:17.752 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:17.740+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:18.205 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:18.192+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:18.729 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:18.716+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:19.243 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:19.232+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:19.759 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:19.748+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:20.264 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:20.252+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:20.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:20.768+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:21.217 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:21.204+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:21.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:21.800+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:22.258 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:22.248+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:22.769 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:22.756+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:23.252 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:23.240+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:23.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:23.768+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:24.301 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:24.288+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:24.750 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:24.740+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:25.299 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:25.288+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:25.733 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:25.720+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:26.287 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:26.276+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:26.734 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:26.724+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:27.281 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:27.268+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:27.782 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:27.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:28.266 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:28.256+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:28.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:28.816+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:29.287 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:29.276+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:29.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:29.828+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:30.250 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:30.240+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:30.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:30.836+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:31.294 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:31.284+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:31.808 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:31.796+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:32.341 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:32.328+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:32.820 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:32.808+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:33.323 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:33.312+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:33.798 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:33.788+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:34.297 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:34.284+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:34.756 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:34.744+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:35.306 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:35.296+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:35.709 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:35.696+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:36.315 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:36.304+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:36.752 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:36.740+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:37.294 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:37.284+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:37.772 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:37.760+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:38.307 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:38.296+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:38.802 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:38.792+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:39.281 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:39.272+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:39.783 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:39.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:40.315 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:40.304+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:40.738 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:40.728+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:41.340 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:41.328+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:41.745 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:41.736+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:42.377 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:42.364+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:42.764 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:42.752+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:43.407 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:43.396+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:43.814 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:43.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:44.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:44.368+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:44.788 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:44.776+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:45.404 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:45.392+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:45.782 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:45.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:46.426 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:46.416+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:46.765 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:46.752+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:47.446 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:47.436+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:47.759 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:47.748+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:48.458 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:48.448+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:48.731 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:48.720+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:49.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:49.456+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:49.764 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:49.752+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:50.435 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:50.424+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:50.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:50.800+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:51.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:51.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:51.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:51.792+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:52.428 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:52.416+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:52.814 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:52.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:53.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:53.452+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:53.772 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:53.760+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:54.456 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:54.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:54.791 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:54.780+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:55.408 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:55.396+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:55.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:55.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:56.386 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:56.376+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:56.788 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:56.776+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:57.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:57.424+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:57.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:57.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:58.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:58.464+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:58.871 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:58.860+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:06:59.455 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:06:59.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:06:59.918 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:06:59.908+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:00.483 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:00.472+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:00.892 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:00.880+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:01.496 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:01.484+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:01.878 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:01.868+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:02.529 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:02.520+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:02.860 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:02.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:03.519 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:03.508+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:03.841 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:03.832+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:04.513 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:04.504+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:04.830 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:04.820+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:05.477 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:05.468+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:05.782 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:05.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:06.492 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:06.480+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:06.804 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:06.792+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:07.519 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:07.508+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:07.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:07.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:08.523 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:08.512+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:08.797 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:08.788+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:09.561 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:09.548+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:09.812 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:09.800+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:10.564 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:10.552+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:10.783 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:10.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:11.594 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:11.584+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:11.775 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:11.764+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:12.641 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:12.632+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:12.762 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:12.752+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:13.650 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:13.640+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:13.797 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:13.788+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:14.688 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:14.676+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:14.776 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:14.764+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:15.728 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:15.716+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:15.792 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:15.780+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:16.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:16.696+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:16.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:16.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:17.673 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:17.664+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:17.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:17.764+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:18.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:18.664+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:18.758 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:18.748+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:19.635 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:19.624+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:19.724 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:19.712+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:20.661 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:20.652+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:20.719 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:20.708+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:21.668 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:21.656+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:21.762 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:21.752+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:22.689 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:22.680+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:22.726 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:22.716+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:23.725 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:23.716+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:23.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:23.740+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:24.681 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:24.672+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:24.764 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:24.752+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:25.645 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:25.636+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:25.801 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:25.792+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:26.651 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:26.640+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:26.821 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:26.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:27.608 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:27.596+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:27.858 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:27.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:28.654 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:28.644+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:28.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:28.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:29.630 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:29.620+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:29.806 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:29.796+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:30.590 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:30.580+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:30.802 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:30.792+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:31.551 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:31.540+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:31.807 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:31.796+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:32.580 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:32.568+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:32.804 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:32.792+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:33.589 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:33.580+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:33.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:33.764+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:34.569 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:34.560+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:34.761 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:34.752+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:35.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:35.564+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:35.769 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:35.760+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:36.564 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:36.556+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:36.754 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:36.744+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:37.534 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:37.524+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:37.743 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:37.732+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:38.571 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:38.560+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:38.730 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:38.720+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:39.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:39.516+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:39.725 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:39.716+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:40.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:40.516+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:40.738 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:40.728+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:41.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:41.528+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:41.699 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:41.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:42.554 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:42.544+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:42.685 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:42.676+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:43.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:43.596+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:43.676 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:43.664+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:44.568 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:44.556+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:44.645 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:44.636+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:45.569 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:45.560+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:45.694 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:45.684+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:46.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:46.520+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:46.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:46.728+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:47.509 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:47.500+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:47.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:47.736+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:48.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:48.456+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:48.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:48.732+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:49.425 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:49.416+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:49.711 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:49.700+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:50.399 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:50.388+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:50.717 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:50.708+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:51.383 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:51.372+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:51.758 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:51.748+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:52.418 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:52.408+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:52.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:52.784+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:53.455 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:53.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:53.755 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:53.744+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:54.445 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:54.436+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:54.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:54.696+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:55.478 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:55.468+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:55.751 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:55.740+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:56.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:56.452+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:56.745 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:56.736+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:57.478 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:57.468+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:57.722 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:57.712+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:58.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:58.496+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:58.750 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:58.740+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:07:59.554 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:07:59.544+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:07:59.701 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:07:59.692+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:00.558 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:00.548+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:00.688 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:00.676+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:01.514 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:01.504+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:01.711 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:01.700+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:02.514 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:02.504+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:02.744 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:02.736+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:03.506 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:03.496+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:03.699 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:03.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:04.546 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:04.536+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:04.689 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:04.680+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:05.511 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:05.500+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:05.697 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:05.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:06.552 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:06.544+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:06.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:06.732+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:07.589 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:07.580+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:07.711 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:07.700+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:08.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:08.548+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:08.665 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:08.656+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:09.587 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:09.576+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:09.703 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:09.692+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:10.599 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:10.588+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:10.726 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:10.716+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:11.583 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:11.572+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:11.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:11.676+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:12.570 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:12.560+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:12.672 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:12.656+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:13.586 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:13.576+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:13.685 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:13.676+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:14.616 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:14.608+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:14.706 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:14.696+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:15.631 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:15.620+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:15.734 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:15.724+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:16.653 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:16.644+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:16.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:16.776+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:17.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:17.692+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:17.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:17.816+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:18.720 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:18.712+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:18.848 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:18.836+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:19.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:19.740+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:19.802 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:19.792+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:20.706 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:20.696+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:20.766 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:20.756+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:21.708 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:21.700+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:21.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:21.724+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:22.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:22.656+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:22.714 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:22.704+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:23.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:23.636+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:23.697 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:23.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:24.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:24.664+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:24.722 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:24.712+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:25.631 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:25.620+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:25.742 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:25.732+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:26.596 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:26.584+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:26.752 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:26.744+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:27.568 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:27.560+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:27.782 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:27.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:28.552 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:28.540+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:28.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:28.740+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:29.521 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:29.512+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:29.755 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:29.744+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:30.566 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:30.556+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:30.708 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:30.700+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:31.544 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:31.532+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:31.695 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:31.684+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:32.548 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:32.540+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:32.683 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:32.672+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:33.557 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:33.548+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:33.679 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:33.668+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:34.515 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:34.504+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:34.663 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:34.652+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:35.491 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:35.480+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:35.664 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:35.656+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:36.452 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:36.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:36.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:36.696+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:37.461 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:37.452+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:37.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:37.696+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:38.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:38.428+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:38.732 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:38.724+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:39.448 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:39.440+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:39.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:39.768+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:40.494 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:40.484+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:40.738 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:40.728+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:41.495 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:41.484+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:41.762 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:41.753+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:42.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:42.529+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:42.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:42.777+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:43.549 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:43.541+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:43.765 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:43.757+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:44.550 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:44.541+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:44.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:44.801+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:45.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:45.533+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:45.783 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:45.773+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:46.548 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:46.541+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:46.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:46.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:47.529 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:47.521+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:47.820 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:47.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:48.504 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:48.497+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:48.871 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:48.861+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:49.522 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:49.513+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:49.889 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:49.881+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:50.531 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:50.521+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:50.935 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:50.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:51.574 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:51.565+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:51.950 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:51.941+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:52.579 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:52.569+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:52.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:52.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:53.620 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:53.613+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:54.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:54.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:54.598 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:54.589+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:54.995 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:54.985+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:55.603 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:55.593+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:55.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:55.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:56.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:56.625+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:57.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:56.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:57.594 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:57.585+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:58.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:58.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:58.644 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:58.637+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:08:59.036 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:08:59.029+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:08:59.616 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:08:59.609+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:00.050 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:00.041+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:00.627 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:00.621+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:01.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:01.009+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:01.601 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:01.593+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:02.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:02.025+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:02.610 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:02.601+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:03.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:03.053+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:03.649 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:03.641+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:04.087 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:04.077+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:04.696 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:04.689+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:05.096 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:05.089+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:05.651 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:05.641+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:06.107 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:06.101+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:06.644 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:06.637+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:07.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:07.121+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:07.623 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:07.613+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:08.128 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:08.121+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:08.589 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:08.581+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:09.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:09.133+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:09.584 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:09.577+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:10.174 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:10.165+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:10.570 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:10.561+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:11.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:11.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:11.601 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:11.593+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:12.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:12.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:12.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:12.549+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:13.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:13.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:13.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:13.549+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:14.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:14.125+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:14.575 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:14.569+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:15.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:15.153+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:15.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:15.569+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:16.173 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:16.165+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:16.572 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:16.565+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:17.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:17.133+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:17.561 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:17.553+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:18.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:18.169+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:18.574 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:18.565+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:19.187 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:19.177+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:19.571 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:19.565+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:20.148 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:20.141+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:20.577 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:20.569+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:21.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:21.121+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:21.534 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:21.525+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:22.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:22.113+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:22.498 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:22.489+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:23.145 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:23.137+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:23.455 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:23.449+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:24.115 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:24.105+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:24.484 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:24.477+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:25.136 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:25.129+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:25.506 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:25.497+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:26.108 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:26.101+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:26.498 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:26.489+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:27.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:27.085+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:27.505 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:27.497+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:28.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:28.085+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:28.458 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:28.449+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:29.051 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:29.041+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:29.426 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:29.417+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:30.064 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:30.057+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:30.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:30.453+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:31.086 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:31.077+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:31.509 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:31.501+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:32.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:32.077+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:32.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:32.533+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:33.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:33.121+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:33.552 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:33.545+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:34.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:34.133+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:34.543 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:34.533+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:35.096 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:35.089+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:35.517 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:35.509+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:36.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:36.097+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:36.538 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:36.529+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:37.133 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:37.125+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:37.554 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:37.545+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:38.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:38.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:38.577 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:38.569+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:39.078 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:39.069+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:39.609 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:39.601+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:40.037 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:40.029+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:40.625 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:40.617+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:41.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:41.077+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:41.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:41.625+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:42.052 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:42.045+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:42.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:42.597+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:43.023 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:43.017+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:43.575 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:43.569+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:44.003 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:43.993+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:44.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:44.569+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:45.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:44.993+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:45.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:45.533+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:46.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:46.021+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:46.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:46.533+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:46.993 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:46.985+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:47.555 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:47.545+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:47.951 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:47.941+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:48.522 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:48.513+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:48.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:48.949+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:49.509 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:49.501+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:49.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:49.909+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:50.462 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:50.453+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:50.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:50.869+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:51.462 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:51.453+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:51.905 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:51.897+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:52.422 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:52.413+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:52.860 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:52.853+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:53.458 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:53.449+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:53.825 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:53.817+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:54.433 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:54.425+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:54.808 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:54.797+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:55.433 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:55.425+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:55.845 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:55.837+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:56.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:56.385+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:56.814 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:56.805+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:57.375 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:57.361+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:57.831 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:57.821+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:58.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:58.329+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:58.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:58.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:09:59.338 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:09:59.329+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:09:59.882 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:09:59.873+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:00.313 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:00.305+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:00.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:00.869+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:01.325 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:01.317+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:01.874 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:01.865+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:02.308 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:02.301+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:02.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:02.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:03.283 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:03.273+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:03.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:03.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:04.251 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:04.241+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:04.986 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:04.977+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:05.239 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:05.229+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:05.946 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:05.937+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:06.236 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:06.229+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:06.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:06.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:07.219 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:07.213+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:08.005 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:07.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:08.207 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:08.197+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:09.052 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:09.045+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:09.162 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:09.153+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:10.029 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:10.021+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:10.123 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:10.117+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:11.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:11.009+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:11.104 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:11.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:12.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:12.033+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:12.143 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:12.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:13.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:13.033+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:13.158 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:13.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:14.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:14.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:14.198 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:14.189+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:14.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:14.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:15.190 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:15.181+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:15.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:15.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:16.155 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:16.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:16.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:16.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:17.111 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:17.101+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:17.971 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:17.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:18.145 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:18.137+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:18.952 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:18.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:19.194 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:19.185+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:19.988 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:19.981+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:20.181 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:20.173+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:21.038 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:21.029+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:21.156 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:21.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:22.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:22.017+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:22.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:22.141+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:23.025 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:23.017+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:23.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:23.157+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:24.064 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:24.057+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:24.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:24.197+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:25.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:25.037+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:25.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:25.189+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:26.012 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:26.005+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:26.164 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:26.157+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:27.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:27.005+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:27.136 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:27.129+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:27.989 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:27.981+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:28.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:28.145+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:28.992 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:28.985+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:29.165 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:29.157+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:29.977 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:29.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:30.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:30.197+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:30.974 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:30.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:31.232 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:31.225+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:31.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:31.949+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:32.251 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:32.245+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:33.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:33.001+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:33.226 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:33.217+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:33.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:33.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:34.191 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:34.185+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:34.999 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:34.989+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:35.165 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:35.157+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:36.036 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:36.029+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:36.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:36.169+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:37.066 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:37.057+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:37.137 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:37.129+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:38.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:38.065+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:38.124 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:38.117+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:39.083 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:39.077+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:39.118 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:39.109+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:40.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:40.077+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:40.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:40.113+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:41.071 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:41.065+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:41.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:41.077+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:42.103 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:42.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:42.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:42.097+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:43.073 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:43.065+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:43.120 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:43.113+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:44.093 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:44.085+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:44.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:44.097+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:45.116 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:45.109+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:45.151 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:45.145+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:46.120 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:46.113+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:46.151 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:46.141+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:47.116 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:47.109+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:47.197 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:47.189+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:48.108 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:48.101+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:48.174 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:48.165+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:49.086 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:49.077+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:49.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:49.181+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:50.051 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:50.045+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:50.156 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:50.149+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:51.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:51.081+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:51.187 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:51.181+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:52.090 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:52.081+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:52.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:52.137+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:53.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:53.077+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:53.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:53.105+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:54.060 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:54.053+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:54.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:54.073+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:55.071 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:55.065+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:55.100 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:55.093+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:56.026 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:56.017+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:56.129 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:56.121+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:56.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:56.981+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:57.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:57.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:58.031 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:58.025+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:58.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:58.177+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:58.985 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:58.977+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:10:59.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:10:59.197+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:10:59.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:10:59.965+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:00.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:00.201+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:01.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:01.009+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:01.217 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:01.209+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:01.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:01.981+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:02.241 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:02.233+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:02.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:02.965+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:03.272 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:03.265+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:03.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:03.973+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:04.227 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:04.221+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:05.023 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:05.013+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:05.234 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:05.225+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:06.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:06.061+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:06.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:06.245+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:07.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:07.053+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:07.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:07.201+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:08.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:08.021+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:08.173 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:08.165+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:09.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:09.061+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:09.125 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:09.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:10.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:10.033+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:10.122 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:10.113+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:11.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:11.013+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:11.111 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:11.105+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:11.995 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:11.989+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:12.115 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:12.109+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:12.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:12.973+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:13.099 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:13.093+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:13.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:13.981+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:14.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:14.049+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:14.984 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:14.977+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:15.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:15.089+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:15.946 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:15.937+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:16.059 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:16.045+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:16.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:16.945+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:17.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:16.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:17.975 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:17.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:18.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:18.001+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:18.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:18.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:18.976 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:18.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:19.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:19.941+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:20.012 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:20.005+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:20.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:20.981+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:21.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:21.045+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:22.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:22.005+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:22.077 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:22.069+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:23.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:23.005+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:23.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:23.033+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:24.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:23.997+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:24.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:24.025+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:24.987 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:24.981+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:25.040 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:25.033+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:25.985 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:25.977+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:26.020 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:26.013+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:26.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:26.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:26.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:26.985+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:27.967 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:27.960+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:28.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:27.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:28.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:28.972+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:29.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:29.008+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:29.937 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:29.928+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:30.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:30.048+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:30.939 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:30.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:31.027 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:31.020+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:31.980 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:31.972+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:32.014 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:32.004+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:32.948 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:32.936+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:32.998 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:32.992+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:33.965 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:33.956+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:34.040 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:34.032+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:34.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:34.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:35.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:35.060+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:35.940 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:35.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:36.109 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:36.100+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:36.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:36.940+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:37.078 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:37.068+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:37.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:37.972+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:38.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:38.080+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:38.949 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:38.940+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:39.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:39.048+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:39.960 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:39.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:40.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:40.096+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:40.985 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:40.976+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:41.061 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:41.052+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:42.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:42.008+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:42.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:42.068+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:43.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:43.016+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:43.059 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:43.052+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:44.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:43.996+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:44.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:44.012+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:44.960 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:44.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:45.023 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:45.016+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:45.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:45.960+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:46.044 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:46.036+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:47.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:46.996+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:47.092 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:47.084+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:47.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:47.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:48.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:48.060+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:48.975 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:48.968+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:49.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:49.012+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:49.974 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:49.964+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:50.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:50.016+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:50.954 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:50.944+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:51.025 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:51.016+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:51.954 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:51.944+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:51.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:51.984+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:52.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:52.940+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:52.995 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:52.988+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:53.978 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:53.968+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:54.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:53.992+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:54.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:54.952+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:54.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:54.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:55.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:55.928+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:55.939 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:55.932+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:56.900 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:56.892+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:56.941 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:56.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:57.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:57.924+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:57.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:57.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:58.896 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:58.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:11:58.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:58.904+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:59.904 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:11:59.896+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:11:59.912 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:11:59.904+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:00.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:00.864+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:00.918 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:00.908+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:01.862 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:01.852+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:01.937 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:01.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:02.907 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:02.900+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:02.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:02.900+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:03.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:03.876+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:03.942 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:03.932+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:04.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:04.828+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:04.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:04.980+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:05.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:05.832+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:05.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:05.968+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:06.888 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:06.880+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:06.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:06.980+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:07.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:07.868+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:08.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:08.008+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:08.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:08.900+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:09.049 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:09.040+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:09.958 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:09.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:10.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:10.044+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:10.960 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:10.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:11.099 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:11.092+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:11.971 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:11.960+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:12.056 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:12.044+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:12.980 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:12.972+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:13.107 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:13.096+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:14.027 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:14.020+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:14.118 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:14.112+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:15.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:15.068+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:15.146 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:15.140+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:16.036 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:16.028+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:16.171 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:16.164+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:17.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:17.020+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:17.161 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:17.152+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:18.070 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:18.064+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:18.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:18.120+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:19.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:19.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:19.123 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:19.112+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:20.141 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:20.132+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:20.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:20.152+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:21.124 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:21.116+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:21.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:21.148+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:22.079 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:22.068+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:22.206 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:22.196+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:23.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:23.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:23.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:23.212+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:24.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:24.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:24.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:24.228+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:25.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:25.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:25.201 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:25.192+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:26.049 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:26.040+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:26.216 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:26.208+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:27.052 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:27.044+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:27.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:27.248+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:28.052 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:28.044+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:28.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:28.252+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:29.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:29.004+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:29.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:29.204+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:30.050 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:30.044+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:30.219 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:30.212+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:31.096 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:31.088+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:31.248 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:31.240+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:32.113 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:32.104+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:32.286 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:32.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:33.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:33.092+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:33.274 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:33.268+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:34.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:34.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:34.267 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:34.260+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:35.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:35.056+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:35.227 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:35.220+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:36.059 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:36.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:36.275 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:36.268+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:37.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:37.004+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:37.311 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:37.304+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:38.036 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:38.028+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:38.352 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:38.344+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:38.994 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:38.988+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:39.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:39.340+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:39.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:39.980+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:40.313 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:40.304+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:40.956 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:40.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:41.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:41.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:41.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:41.936+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:42.326 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:42.320+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:42.983 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:42.976+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:43.282 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:43.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:43.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:43.960+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:44.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:44.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:44.939 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:44.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:45.251 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:45.244+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:45.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:45.900+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:46.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:46.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:46.936 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:46.928+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:47.250 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:47.244+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:47.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:47.884+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:48.287 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:48.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:48.925 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:48.916+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:49.283 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:49.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:49.965 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:49.956+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:50.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:50.244+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:50.981 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:50.972+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:51.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:51.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:51.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:51.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:52.328 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:52.320+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:53.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:53.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:53.284 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:53.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:54.009 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:54.000+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:54.251 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:54.240+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:55.033 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:55.024+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:55.216 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:55.208+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:56.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:56.048+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:56.243 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:56.236+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:57.047 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:57.040+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:57.268 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:57.260+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:58.010 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:58.004+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:58.310 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:58.304+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:12:59.023 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:12:59.016+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:12:59.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:12:59.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:00.020 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:00.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:00.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:00.296+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:01.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:01.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:01.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:01.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:02.064 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:02.056+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:02.342 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:02.336+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:03.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:03.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:03.338 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:03.332+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:04.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:03.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:04.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:04.300+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:05.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:05.028+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:05.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:05.264+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:06.056 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:06.048+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:06.229 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:06.220+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:07.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:07.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:07.221 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:07.212+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:08.046 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:08.040+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:08.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:08.224+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:09.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:09.024+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:09.274 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:09.264+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:10.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:10.016+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:10.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:10.308+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:11.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:10.996+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:11.325 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:11.316+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:12.034 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:12.028+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:12.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:12.336+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:12.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:12.980+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:13.352 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:13.344+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:13.941 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:13.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:14.346 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:14.340+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:14.924 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:14.916+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:15.328 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:15.320+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:15.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:15.900+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:16.288 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:16.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:16.876 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:16.868+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:17.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:17.256+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:17.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:17.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:18.247 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:18.240+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:18.821 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:18.812+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:19.254 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:19.248+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:19.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:19.832+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:20.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:20.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:20.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:20.872+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:21.299 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:21.292+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:21.920 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:21.912+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:22.267 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:22.260+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:22.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:22.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:23.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:23.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:23.904 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:23.896+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:24.320 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:24.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:24.948 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:24.940+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:25.275 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:25.268+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:25.961 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:25.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:26.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:26.228+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:26.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:26.924+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:27.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:27.224+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:27.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:27.956+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:28.267 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:28.260+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:28.922 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:28.916+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:29.226 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:29.220+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:29.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:29.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:30.209 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:30.200+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:30.995 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:30.988+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:31.218 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:31.212+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:32.035 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:32.028+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:32.240 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:32.232+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:33.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:33.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:33.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:33.228+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:34.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:34.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:34.248 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:34.240+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:35.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:35.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:35.245 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:35.236+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:36.144 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:36.136+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:36.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:36.272+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:37.135 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:37.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:37.289 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:37.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:38.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:38.144+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:38.274 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:38.268+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:39.107 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:39.100+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:39.322 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:39.316+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:40.090 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:40.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:40.320 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:40.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:41.082 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:41.072+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:41.314 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:41.308+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:42.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:42.064+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:42.269 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:42.260+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:43.082 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:43.072+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:43.252 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:43.244+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:44.033 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:44.024+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:44.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:44.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:44.992 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:44.984+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:45.294 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:45.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:46.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:45.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:46.327 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:46.320+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:46.994 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:46.988+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:47.288 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:47.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:47.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:47.940+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:48.298 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:48.292+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:48.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:48.912+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:49.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:49.268+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:49.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:49.884+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:50.308 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:50.300+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:50.862 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:50.856+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:51.314 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:51.308+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:51.873 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:51.864+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:52.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:52.324+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:52.857 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:52.848+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:53.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:53.328+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:53.867 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:53.836+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:54.332 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:54.320+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:54.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:54.808+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:55.305 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:55.296+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:55.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:55.852+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:56.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:56.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:56.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:56.904+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:57.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:57.296+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:57.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:57.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:58.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:58.256+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:58.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:58.864+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:13:59.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:13:59.256+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:13:59.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:13:59.864+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:00.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:00.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:00.895 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:00.888+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:01.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:01.256+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:01.933 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:01.924+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:02.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:02.268+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:02.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:02.968+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:03.286 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:03.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:03.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:03.944+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:04.288 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:04.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:04.931 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:04.924+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:05.320 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:05.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:05.933 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:05.924+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:06.363 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:06.356+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:06.975 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:06.968+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:07.363 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:07.356+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:08.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:07.996+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:08.386 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:08.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:08.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:08.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:09.427 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:09.420+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:09.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:09.912+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:10.477 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:10.468+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:10.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:10.924+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:11.471 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:11.460+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:11.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:11.956+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:12.474 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:12.468+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:12.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:12.924+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:13.430 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:13.424+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:13.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:13.928+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:14.409 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:14.400+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:14.944 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:14.936+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:15.381 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:15.372+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:15.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:15.980+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:16.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:16.368+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:17.038 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:17.032+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:17.424 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:17.416+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:18.060 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:18.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:18.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:18.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:19.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:19.032+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:19.373 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:19.364+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:20.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:20.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:20.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:20.384+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:21.080 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:21.072+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:21.363 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:21.356+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:22.070 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:22.064+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:22.410 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:22.404+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:23.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:23.036+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:23.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:23.432+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:24.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:24.024+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:24.449 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:24.444+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:25.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:24.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:25.476 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:25.468+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:26.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:26.036+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:26.439 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:26.432+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:27.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:26.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:27.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:27.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:27.980 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:27.972+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:28.414 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:28.408+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:29.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:28.996+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:29.454 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:29.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:29.961 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:29.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:30.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:30.404+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:30.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:30.956+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:31.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:31.408+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:31.956 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:31.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:32.444 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:32.436+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:32.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:32.940+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:33.456 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:33.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:33.913 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:33.904+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:34.461 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:34.452+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:34.875 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:34.868+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:35.475 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:35.468+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:35.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:35.860+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:36.481 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:36.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:36.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:36.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:37.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:37.432+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:37.860 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:37.852+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:38.490 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:38.484+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:38.895 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:38.888+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:39.509 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:39.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:39.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:39.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:40.478 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:40.472+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:40.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:40.884+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:41.451 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:41.444+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:41.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:41.928+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:42.446 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:42.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:42.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:42.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:43.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:43.428+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:43.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:43.964+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:44.391 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:44.384+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:44.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:44.980+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:45.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:45.368+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:46.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:46.016+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:46.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:46.348+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:47.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:47.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:47.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:47.328+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:48.086 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:48.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:48.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:48.352+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:49.086 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:49.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:49.370 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:49.364+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:50.047 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:50.040+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:50.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:50.344+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:51.075 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:51.068+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:51.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:51.384+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:52.126 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:52.120+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:52.408 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:52.400+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:53.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:53.112+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:53.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:53.372+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:54.092 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:54.084+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:54.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:54.324+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:55.097 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:55.088+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:55.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:55.328+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:56.067 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:56.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:56.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:56.376+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:57.086 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:57.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:57.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:57.404+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:58.054 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:58.048+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:58.439 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:58.432+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:14:59.060 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:14:59.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:14:59.474 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:14:59.468+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:00.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:00.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:00.433 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:00.428+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:01.136 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:01.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:01.405 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:01.396+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:02.186 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:02.180+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:02.450 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:02.444+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:03.184 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:03.176+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:03.407 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:03.400+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:04.154 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:04.148+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:04.431 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:04.424+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:05.165 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:05.156+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:05.444 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:05.436+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:06.134 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:06.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:06.427 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:06.420+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:07.100 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:07.092+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:07.392 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:07.384+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:08.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:08.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:08.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:08.428+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:09.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:09.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:09.477 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:09.472+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:10.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:10.016+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:10.502 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:10.492+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:10.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:10.976+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:11.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:11.464+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:12.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:12.016+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:12.478 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:12.472+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:13.031 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:13.024+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:13.481 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:13.472+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:14.050 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:14.044+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:14.497 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:14.488+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:15.080 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:15.072+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:15.522 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:15.512+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:16.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:16.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:16.536 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:16.528+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:17.111 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:17.104+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:17.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:17.512+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:18.136 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:18.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:18.543 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:18.536+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:19.142 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:19.136+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:19.549 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:19.544+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:20.126 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:20.120+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:20.517 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:20.508+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:21.095 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:21.088+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:21.469 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:21.464+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:22.131 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:22.124+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:22.485 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:22.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:23.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:23.160+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:23.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:23.464+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:24.188 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:24.180+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:24.489 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:24.484+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:25.217 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:25.208+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:25.462 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:25.456+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:26.182 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:26.176+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:26.427 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:26.420+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:27.149 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:27.144+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:27.446 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:27.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:28.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:28.160+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:28.409 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:28.404+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:29.133 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:29.124+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:29.396 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:29.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:30.168 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:30.160+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:30.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:30.396+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:31.140 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:31.132+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:31.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:31.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:32.124 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:32.116+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:32.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:32.376+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:33.076 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:33.068+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:33.389 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:33.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:34.092 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:34.084+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:34.361 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:34.356+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:35.058 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:35.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:35.402 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:35.396+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:36.067 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:36.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:36.359 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:36.352+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:37.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:37.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:37.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:37.340+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:38.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:38.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:38.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:38.328+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:39.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:39.076+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:39.314 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:39.308+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:40.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:40.100+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:40.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:40.340+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:41.120 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:41.112+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:41.300 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:41.292+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:42.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:42.084+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:42.290 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:42.284+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:43.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:43.076+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:43.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:43.284+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:44.046 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:44.040+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:44.250 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:44.244+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:45.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:44.996+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:45.284 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:45.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:46.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:46.008+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:46.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:46.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:47.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:47.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:47.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:47.304+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:48.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:48.036+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:48.358 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:48.352+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:49.056 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:49.048+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:49.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:49.396+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:50.064 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:50.056+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:50.387 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:50.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:51.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:51.108+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:51.352 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:51.344+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:52.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:52.120+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:52.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:52.328+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:53.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:53.084+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:53.289 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:53.284+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:54.056 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:54.048+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:54.337 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:54.332+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:55.070 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:55.064+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:55.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:55.340+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:56.023 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:56.016+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:56.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:56.340+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:57.034 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:57.028+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:57.307 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:57.300+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:57.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:57.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:58.324 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:58.316+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:15:58.983 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:15:58.976+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:15:59.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:15:59.296+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:00.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:00.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:00.352 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:00.344+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:01.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:01.008+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:01.343 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:01.336+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:02.036 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:02.028+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:02.358 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:02.352+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:03.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:03.000+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:03.365 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:03.360+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:04.054 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:04.048+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:04.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:04.368+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:05.045 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:05.036+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:05.387 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:05.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:06.059 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:06.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:06.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:06.368+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:07.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:07.068+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:07.424 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:07.416+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:08.068 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:08.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:08.464 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:08.456+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:09.116 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:09.108+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:09.455 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:09.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:10.134 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:10.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:10.496 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:10.488+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:11.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:11.084+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:11.456 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:11.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:12.094 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:12.088+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:12.491 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:12.484+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:13.071 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:13.064+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:13.509 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:13.504+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:14.064 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:14.056+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:14.469 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:14.464+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:15.097 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:15.091+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:15.466 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:15.459+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:16.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:16.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:16.504 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:16.495+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:17.142 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:17.135+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:17.476 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:17.467+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:18.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:18.095+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:18.428 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:18.419+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:19.075 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:19.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:19.478 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:19.471+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:20.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:20.051+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:20.499 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:20.487+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:21.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:21.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:21.492 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:21.483+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:22.117 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:22.107+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:22.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:22.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:23.163 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:23.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:23.526 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:23.519+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:24.117 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:24.111+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:24.567 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:24.559+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:25.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:25.079+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:25.526 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:25.515+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:26.040 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:26.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:26.521 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:26.511+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:27.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:27.079+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:27.569 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:27.563+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:28.056 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:28.047+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:28.531 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:28.523+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:29.009 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:28.999+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:29.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:29.567+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:30.053 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:30.047+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:30.536 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:30.527+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:31.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:31.015+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:31.556 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:31.547+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:31.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:31.987+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:32.542 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:32.535+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:32.981 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:32.971+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:33.546 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:33.539+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:34.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:34.023+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:34.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:34.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:35.007 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:34.999+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:35.540 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:35.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:35.978 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:35.971+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:36.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:36.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:36.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:36.951+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:37.584 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:37.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:37.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:37.955+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:38.547 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:38.539+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:38.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:38.927+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:39.501 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:39.495+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:39.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:39.907+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:40.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:40.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:40.965 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:40.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:41.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:41.519+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:41.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:41.927+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:42.540 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:42.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:42.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:42.963+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:43.517 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:43.511+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:43.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:43.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:44.551 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:44.543+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:44.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:44.971+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:45.516 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:45.507+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:46.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:45.995+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:46.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:46.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:47.007 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:46.999+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:47.495 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:47.487+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:48.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:48.003+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:48.485 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:48.479+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:49.010 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:49.003+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:49.507 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:49.499+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:50.025 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:50.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:50.558 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:50.551+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:51.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:51.011+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:51.563 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:51.555+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:51.992 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:51.983+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:52.608 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:52.599+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:52.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:52.955+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:53.614 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:53.607+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:53.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:53.943+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:54.597 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:54.591+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:54.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:54.951+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:55.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:55.555+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:55.981 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:55.975+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:56.528 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:56.519+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:56.985 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:56.979+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:57.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:57.539+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:57.957 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:57.951+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:58.511 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:58.503+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:58.992 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:58.983+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:16:59.554 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:16:59.547+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:16:59.980 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:16:59.971+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:00.514 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:00.507+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:01.025 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:01.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:01.551 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:01.543+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:02.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:02.035+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:02.541 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:02.535+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:03.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:03.063+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:03.559 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:03.551+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:04.070 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:04.063+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:04.610 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:04.603+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:05.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:05.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:05.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:05.567+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:06.125 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:06.119+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:06.597 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:06.591+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:07.136 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:07.127+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:07.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:07.595+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:08.164 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:08.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:08.621 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:08.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:09.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:09.183+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:09.645 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:09.639+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:10.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:10.159+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:10.618 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:10.611+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:11.121 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:11.115+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:11.594 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:11.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:12.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:12.099+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:12.627 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:12.619+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:13.075 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:13.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:13.590 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:13.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:14.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:14.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:14.627 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:14.619+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:15.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:15.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:15.667 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:15.659+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:16.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:16.107+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:16.710 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:16.703+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:17.131 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:17.123+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:17.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:17.731+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:18.136 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:18.127+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:18.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:18.739+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:19.115 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:19.107+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:19.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:19.787+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:20.111 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:20.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:20.745 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:20.739+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:21.158 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:21.151+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:21.708 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:21.699+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:22.170 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:22.163+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:22.752 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:22.743+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:23.139 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:23.131+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:23.728 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:23.719+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:24.119 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:24.111+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:24.712 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:24.707+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:25.080 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:25.071+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:25.712 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:25.703+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:26.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:26.075+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:26.753 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:26.747+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:27.048 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:27.039+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:27.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:27.787+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:28.090 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:28.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:28.773 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:28.767+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:29.097 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:29.091+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:29.775 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:29.767+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:30.142 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:30.135+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:30.754 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:30.747+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:31.100 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:31.095+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:31.798 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:31.791+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:32.101 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:32.095+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:32.765 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:32.759+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:33.078 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:33.071+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:33.783 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:33.775+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:34.076 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:34.071+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:34.806 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:34.799+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:35.115 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:35.107+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:35.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:35.803+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:36.089 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:36.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:36.861 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:36.855+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:37.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:37.055+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:37.881 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:37.875+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:38.047 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:38.039+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:38.841 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:38.835+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:39.051 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:39.043+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:39.877 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:39.871+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:40.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:40.023+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:40.833 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:40.827+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:40.993 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:40.987+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:41.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:41.803+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:42.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:41.995+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:42.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:42.803+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:42.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:42.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:43.801 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:43.795+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:44.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:44.007+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:44.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:44.827+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:45.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:45.055+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:45.877 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:45.871+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:46.065 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:46.059+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:46.847 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:46.839+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:47.053 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:47.047+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:47.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:47.887+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:48.104 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:48.095+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:48.864 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:48.859+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:49.124 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:49.115+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:49.888 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:49.883+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:50.148 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:50.139+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:50.900 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:50.891+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:51.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:51.119+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:51.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:51.867+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:52.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:52.143+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:52.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:52.911+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:53.128 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:53.123+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:53.887 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:53.879+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:54.133 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:54.127+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:54.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:54.887+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:55.173 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:55.167+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:55.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:55.847+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:56.183 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:56.175+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:56.870 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:56.863+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:57.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:57.203+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:57.881 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:57.875+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:58.179 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:58.171+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:58.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:58.847+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:17:59.149 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:17:59.143+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:17:59.869 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:17:59.863+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:00.133 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:00.127+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:00.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:00.907+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:01.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:01.099+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:01.950 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:01.943+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:02.142 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:02.135+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:02.905 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:02.899+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:03.164 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:03.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:03.867 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:03.859+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:04.180 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:04.171+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:04.847 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:04.839+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:05.179 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:05.171+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:05.863 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:05.855+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:06.148 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:06.139+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:06.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:06.867+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:07.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:07.159+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:07.897 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:07.891+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:08.182 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:08.175+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:08.869 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:08.863+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:09.233 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:09.227+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:09.867 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:09.859+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:10.263 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:10.255+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:10.900 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:10.895+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:11.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:11.235+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:11.928 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:11.923+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:12.212 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:12.203+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:12.952 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:12.943+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:13.244 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:13.235+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:13.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:13.931+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:14.250 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:14.243+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:14.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:14.943+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:15.228 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:15.223+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:15.977 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:15.971+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:16.211 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:16.203+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:16.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:16.983+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:17.176 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:17.167+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:18.003 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:17.995+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:18.182 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:18.175+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:19.029 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:19.023+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:19.218 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:19.211+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:20.059 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:20.051+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:20.230 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:20.223+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:21.106 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:21.099+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:21.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:21.203+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:22.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:22.091+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:22.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:22.215+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:23.127 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:23.119+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:23.188 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:23.183+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:24.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:24.139+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:24.146 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:24.139+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:25.113 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:25.107+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:25.191 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:25.183+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:26.099 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:26.091+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:26.232 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:26.227+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:27.125 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:27.119+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:27.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:27.195+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:28.164 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:28.159+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:28.225 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:28.219+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:29.206 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:29.199+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:29.214 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:29.207+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:30.244 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:30.239+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:30.252 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:30.247+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:31.218 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:31.211+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:31.238 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:31.231+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:32.258 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:32.251+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:32.274 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:32.267+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:33.299 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:33.291+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:33.320 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:33.311+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:34.265 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:34.259+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:34.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:34.323+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:35.310 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:35.303+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:35.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:35.327+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:36.295 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:36.287+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:36.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:36.363+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:37.319 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:37.311+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:37.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:37.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:38.329 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:38.323+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:38.363 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:38.355+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:39.342 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:39.335+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:39.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:39.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:40.325 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:40.319+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:40.379 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:40.371+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:41.335 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:41.327+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:41.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:41.379+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:42.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:42.339+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:42.368 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:42.359+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:43.320 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:43.315+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:43.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:43.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:44.343 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:44.335+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:44.379 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:44.371+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:45.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:45.347+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:45.393 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:45.387+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:46.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:46.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:46.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:46.383+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:47.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:47.339+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:47.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:47.387+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:48.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:48.331+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:48.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:48.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:49.310 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:49.303+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:49.391 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:49.383+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:50.281 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:50.275+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:50.442 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:50.435+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:51.323 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:51.315+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:51.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:51.479+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:52.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:52.339+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:52.514 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:52.507+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:53.367 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:53.359+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:53.540 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:53.535+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:54.376 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:54.371+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:54.580 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:54.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:55.352 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:55.347+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:55.605 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:55.599+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:56.329 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:56.323+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:56.583 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:56.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:57.303 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:57.295+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:57.623 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:57.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:58.305 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:58.299+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:58.585 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:58.579+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:18:59.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:18:59.351+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:18:59.557 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:18:59.551+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:00.390 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:00.383+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:00.582 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:00.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:01.380 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:01.375+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:01.622 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:01.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:02.399 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:02.391+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:02.608 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:02.603+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:03.354 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:03.347+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:03.621 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:03.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:04.331 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:04.323+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:04.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:04.611+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:05.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:05.363+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:05.588 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:05.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:06.380 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:06.375+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:06.565 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:06.559+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:07.360 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:07.351+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:07.571 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:07.563+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:08.331 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:08.323+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:08.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:08.571+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:09.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:09.339+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:09.595 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:09.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:10.304 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:10.299+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:10.642 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:10.635+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:11.315 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:11.307+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:11.659 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:11.651+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:12.313 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:12.307+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:12.704 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:12.699+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:13.330 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:13.323+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:13.693 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:13.687+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:14.365 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:14.359+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:14.726 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:14.719+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:15.334 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:15.327+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:15.736 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:15.731+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:16.306 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:16.299+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:16.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:16.739+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:17.279 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:17.271+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:17.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:17.735+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:18.279 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:18.271+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:18.760 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:18.755+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:19.318 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:19.311+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:19.801 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:19.795+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:20.347 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:20.339+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:20.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:20.791+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:21.335 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:21.327+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:21.837 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:21.831+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:22.339 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:22.331+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:22.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:22.791+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:23.321 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:23.315+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:23.781 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:23.775+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:24.316 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:24.311+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:24.753 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:24.747+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:25.300 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:25.295+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:25.737 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:25.731+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:26.309 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:26.303+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:26.733 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:26.727+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:27.317 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:27.311+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:27.693 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:27.687+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:28.280 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:28.275+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:28.660 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:28.655+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:29.256 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:29.251+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:29.639 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:29.631+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:30.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:30.267+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:30.635 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:30.627+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:31.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:31.267+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:31.607 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:31.599+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:32.265 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:32.259+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:32.645 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:32.639+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:33.233 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:33.227+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:33.664 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:33.659+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:34.213 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:34.207+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:34.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:34.699+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:35.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:35.199+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:35.724 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:35.719+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:36.188 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:36.183+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:36.681 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:36.675+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:37.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:37.171+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:37.719 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:37.711+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:38.161 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:38.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:38.690 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:38.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:39.168 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:39.163+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:39.708 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:39.703+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:40.199 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:40.195+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:40.678 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:40.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:41.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:41.215+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:41.653 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:41.647+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:42.180 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:42.175+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:42.689 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:42.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:43.190 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:43.183+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:43.675 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:43.667+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:44.185 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:44.179+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:44.630 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:44.623+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:45.186 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:45.179+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:45.600 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:45.595+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:46.173 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:46.167+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:46.651 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:46.643+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:47.138 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:47.131+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:47.669 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:47.663+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:48.159 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:48.151+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:48.671 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:48.667+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:49.159 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:49.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:49.678 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:49.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:50.136 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:50.127+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:50.658 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:50.651+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:51.168 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:51.163+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:51.660 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:51.655+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:52.216 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:52.211+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:52.636 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:52.631+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:53.224 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:53.219+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:53.606 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:53.599+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:54.245 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:54.239+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:54.561 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:54.555+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:55.202 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:55.195+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:55.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:55.559+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:56.173 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:56.167+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:56.571 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:56.563+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:57.149 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:57.143+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:57.581 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:57.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:58.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:58.107+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:58.606 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:58.599+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:19:59.141 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:19:59.135+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:19:59.630 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:19:59.623+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:00.135 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:00.127+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:00.617 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:00.611+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:01.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:01.147+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:01.631 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:01.627+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:02.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:02.099+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:02.591 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:02.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:03.144 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:03.139+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:03.635 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:03.627+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:04.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:04.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:04.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:04.619+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:05.096 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:05.091+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:05.580 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:05.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:06.090 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:06.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:06.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:06.611+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:07.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:07.039+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:07.585 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:07.579+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:08.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:08.051+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:08.628 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:08.623+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:09.101 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:09.095+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:09.655 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:09.647+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:10.108 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:10.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:10.679 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:10.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:11.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:11.147+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:11.685 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:11.679+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:12.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:12.187+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:12.716 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:12.711+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:13.228 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:13.223+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:13.743 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:13.735+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:14.220 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:14.215+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:14.758 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:14.751+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:15.269 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:15.263+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:15.713 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:15.707+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:16.263 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:16.255+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:16.696 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:16.691+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:17.286 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:17.279+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:17.650 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:17.643+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:18.308 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:18.303+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:18.656 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:18.651+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:19.266 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:19.259+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:19.622 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:19.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:20.253 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:20.247+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:20.617 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:20.611+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:21.270 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:21.263+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:21.630 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:21.623+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:22.269 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:22.263+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:22.677 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:22.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:23.253 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:23.247+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:23.670 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:23.663+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:24.239 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:24.231+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:24.705 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:24.699+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:25.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:25.231+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:25.731 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:25.727+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:26.227 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:26.223+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:26.738 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:26.731+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:27.180 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:27.175+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:27.758 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:27.751+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:28.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:28.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:28.800 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:28.795+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:29.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:29.147+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:29.843 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:29.835+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:30.189 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:30.183+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:30.878 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:30.871+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:31.186 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:31.179+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:31.897 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:31.891+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:32.185 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:32.179+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:32.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:32.903+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:33.181 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:33.175+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:33.909 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:33.903+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:34.139 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:34.131+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:34.951 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:34.943+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:35.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:35.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:36.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:35.995+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:36.180 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:36.175+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:36.996 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:36.991+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:37.177 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:37.171+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:38.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:38.003+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:38.204 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:38.199+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:39.015 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:39.011+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:39.185 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:39.179+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:40.014 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:40.007+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:40.199 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:40.195+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:40.987 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:40.979+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:41.232 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:41.227+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:42.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:41.995+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:42.205 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:42.199+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:42.986 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:42.979+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:43.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:43.203+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:43.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:43.931+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:44.199 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:44.195+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:44.907 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:44.899+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:45.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:45.191+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:45.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:45.887+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:46.159 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:46.151+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:46.941 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:46.935+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:47.128 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:47.123+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:47.920 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:47.915+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:48.119 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:48.111+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:48.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:48.935+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:49.116 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:49.111+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:49.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:49.959+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:50.165 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:50.159+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:50.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:50.951+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:51.173 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:51.167+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:51.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:51.947+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:52.204 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:52.199+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:52.986 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:52.979+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:53.224 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:53.219+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:54.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:54.011+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:54.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:54.235+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:55.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:55.047+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:55.202 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:55.195+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:56.073 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:56.067+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:56.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:56.171+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:57.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:57.099+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:57.152 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:57.147+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:58.118 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:58.111+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:58.162 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:58.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:20:59.160 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:20:59.155+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:20:59.176 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:20:59.171+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:00.184 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:00.179+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:00.191 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:00.183+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:01.225 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:01.219+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:01.226 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:01.219+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:02.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:02.171+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:02.231 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:02.227+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:03.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:03.187+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:03.211 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:03.203+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:04.165 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:04.159+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:04.257 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:04.251+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:05.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:05.171+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:05.266 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:05.259+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:06.163 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:06.159+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:06.219 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:06.215+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:07.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:07.171+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:07.202 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:07.195+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:08.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:08.131+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:08.161 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:08.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:09.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:09.091+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:09.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:09.147+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:10.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:10.055+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:10.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:10.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:11.068 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:11.063+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:11.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:11.099+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:12.079 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:12.071+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:12.117 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:12.111+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:13.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:13.039+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:13.076 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:13.071+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:14.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:14.051+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:14.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:14.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:15.031 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:15.023+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:15.032 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:15.027+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:16.062 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:16.055+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:16.080 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:16.075+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:17.035 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:17.027+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:17.078 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:17.071+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:18.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:18.059+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:18.087 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:18.079+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:19.046 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:19.039+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:19.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:19.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:19.999 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:19.995+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:20.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:20.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:21.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:20.995+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:21.129 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:21.115+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:22.029 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:22.023+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:22.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:22.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:23.059 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:23.055+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:23.157 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:23.151+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:24.109 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:24.103+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:24.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:24.199+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:25.099 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:25.091+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:25.230 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:25.223+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:26.061 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:26.055+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:26.204 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:26.199+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:27.111 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:27.103+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:27.183 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:27.175+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:28.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:28.075+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:28.143 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:28.139+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:29.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:29.051+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:29.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:29.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:30.053 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:30.047+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:30.125 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:30.119+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:31.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:31.003+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:31.088 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:31.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:31.996 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:31.991+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:32.097 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:32.091+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:32.991 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:32.987+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:33.053 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:33.047+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:33.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:33.963+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:34.086 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:34.079+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:35.015 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:35.011+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:35.076 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:35.071+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:36.052 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:36.047+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:36.056 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:36.051+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:37.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:37.063+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:37.099 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:37.091+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:38.081 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:38.075+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:38.111 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:38.107+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:39.099 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:39.095+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:39.139 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:39.135+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:40.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:40.079+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:40.176 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:40.171+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:41.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:41.063+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:41.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:41.171+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:42.040 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:42.035+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:42.139 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:42.135+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:43.049 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:43.043+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:43.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:43.171+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:44.041 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:44.035+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:44.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:44.175+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:45.079 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:45.071+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:45.134 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:45.127+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:46.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:46.055+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:46.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:46.111+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:47.026 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:47.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:47.069 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:47.063+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:47.986 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:47.979+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:48.105 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:48.099+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:48.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:48.963+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:49.074 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:49.067+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:49.936 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:49.931+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:50.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:50.035+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:50.943 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:50.939+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:51.064 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:51.059+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:51.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:51.927+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:52.063 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:52.059+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:52.912 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:52.907+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:53.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:53.051+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:53.906 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:53.899+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:54.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:54.023+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:54.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:54.855+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:55.008 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:55.003+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:55.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:55.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:56.031 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:56.027+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:56.845 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:56.839+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:57.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:57.007+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:57.812 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:57.807+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:58.025 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:58.019+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:58.800 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:58.795+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:59.015 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:59.011+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:21:59.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:21:59.831+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:21:59.983 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:21:59.979+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:00.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:00.839+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:00.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:00.943+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:01.894 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:01.887+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:01.904 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:01.899+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:02.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:02.851+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:02.863 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:02.859+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:03.818 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:03.811+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:03.834 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:03.827+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:04.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:04.787+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:04.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:04.803+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:05.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:05.755+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:05.861 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:05.855+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:06.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:06.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:06.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:06.871+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:07.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:07.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:07.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:07.911+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:08.864 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:08.859+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:08.941 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:08.935+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:09.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:09.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:09.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:09.963+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:10.894 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:10.887+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:10.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:10.939+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:11.882 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:11.875+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:11.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:11.943+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:12.925 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:12.919+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:12.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:12.963+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:13.952 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:13.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:13.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:13.963+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:14.961 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:14.955+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:14.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:14.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:15.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:15.911+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:15.952 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:15.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:16.898 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:16.891+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:16.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:16.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:17.884 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:17.879+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:18.036 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:18.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:18.874 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:18.867+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:18.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:18.983+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:19.907 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:19.903+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:20.032 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:20.027+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:20.873 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:20.867+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:20.985 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:20.979+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:21.874 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:21.867+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:21.957 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:21.951+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:22.865 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:22.859+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:22.942 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:22.935+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:23.823 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:23.819+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:23.904 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:23.899+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:24.787 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:24.783+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:24.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:24.943+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:25.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:25.811+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:25.923 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:25.919+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:26.772 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:26.767+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:26.944 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:26.939+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:27.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:27.731+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:27.924 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:27.919+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:28.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:28.739+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:28.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:28.911+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:29.725 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:29.703+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:29.937 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:29.931+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:30.691 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:30.687+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:30.961 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:30.955+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:31.683 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:31.679+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:31.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:31.975+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:32.645 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:32.639+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:33.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:32.999+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:33.621 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:33.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:34.017 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:34.011+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:34.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:34.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:35.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:35.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:35.581 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:35.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:36.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:36.051+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:36.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:36.611+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:37.106 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:37.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:37.628 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:37.623+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:38.158 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:38.151+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:38.591 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:38.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:39.147 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:39.143+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:39.619 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:39.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:40.106 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:40.099+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:40.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:40.623+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:41.070 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:41.063+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:41.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:41.591+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:42.121 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:42.115+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:42.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:42.571+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:43.150 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:43.143+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:43.535 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:43.527+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:44.139 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:44.135+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:44.536 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:44.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:45.112 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:45.107+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:45.515 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:45.511+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:46.117 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:46.111+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:46.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:46.479+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:47.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:47.095+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:47.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:47.479+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:48.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:48.147+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:48.481 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:48.475+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:49.129 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:49.123+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:49.471 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:49.467+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:50.107 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:50.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:50.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:50.511+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:51.115 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:51.111+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:51.498 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:51.491+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:52.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:52.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:52.471 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:52.467+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:53.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:53.147+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:53.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:53.431+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:54.186 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:54.183+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:54.446 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:54.443+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:55.165 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:55.159+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:55.450 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:55.443+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:56.123 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:56.119+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:56.438 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:56.431+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:57.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:57.159+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:57.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:57.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:58.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:58.171+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:58.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:58.347+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:22:59.162 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:22:59.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:22:59.367 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:22:59.363+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:00.123 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:00.119+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:00.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:00.399+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:01.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:01.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:01.361 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:01.355+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:02.056 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:02.051+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:02.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:02.395+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:03.055 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:03.051+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:03.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:03.387+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:04.007 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:04.003+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:04.396 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:04.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:04.978 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:04.975+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:05.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:05.379+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:05.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:05.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:06.394 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:06.387+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:07.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:07.011+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:07.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:07.383+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:07.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:07.971+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:08.381 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:08.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:09.028 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:09.023+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:09.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:09.343+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:10.023 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:10.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:10.386 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:10.383+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:11.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:11.023+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:11.429 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:11.423+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:12.017 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:12.011+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:12.453 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:12.447+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:13.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:12.995+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:13.415 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:13.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:14.026 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:14.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:14.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:14.399+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:15.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:15.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:15.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:15.351+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:16.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:16.015+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:16.367 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:16.363+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:17.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:17.007+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:17.326 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:17.319+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:18.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:18.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:18.299 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:18.295+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:19.053 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:19.047+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:19.293 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:19.287+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:20.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:20.007+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:20.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:20.303+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:20.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:20.979+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:21.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:21.331+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:22.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:22.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:22.354 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:22.347+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:23.034 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:23.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:23.399 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:23.395+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:24.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:24.059+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:24.381 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:24.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:25.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:25.099+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:25.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:25.371+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:26.130 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:26.122+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:26.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:26.322+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:27.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:27.154+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:27.330 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:27.326+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:28.202 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:28.194+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:28.301 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:28.294+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:29.190 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:29.182+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:29.343 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:29.338+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:30.217 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:30.210+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:30.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:30.298+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:31.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:31.190+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:31.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:31.342+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:32.226 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:32.218+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:32.378 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:32.370+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:33.215 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:33.210+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:33.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:33.350+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:34.238 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:34.230+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:34.337 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:34.330+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:35.228 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:35.222+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:35.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:35.354+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:36.225 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:36.218+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:36.391 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:36.386+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:37.265 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:37.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:37.367 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:37.362+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:38.285 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:38.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:38.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:38.318+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:39.310 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:39.302+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:39.330 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:39.322+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:40.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:40.322+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:40.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:40.326+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:41.293 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:41.286+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:41.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:41.374+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:42.257 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:42.250+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:42.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:42.426+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:43.285 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:43.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:43.387 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:43.382+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:44.283 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:44.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:44.344 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:44.338+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:45.297 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:45.290+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:45.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:45.322+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:46.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:46.314+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:46.352 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:46.346+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:47.301 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:47.294+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:47.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:47.374+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:48.258 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:48.250+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:48.403 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:48.398+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:49.298 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:49.294+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:49.371 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:49.366+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:50.317 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:50.310+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:50.360 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:50.354+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:51.360 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:51.354+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:51.367 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:51.362+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:52.330 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:52.322+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:52.378 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:52.374+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:53.283 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:53.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:53.332 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:53.326+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:54.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:54.306+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:54.315 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:54.310+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:55.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:55.290+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:55.299 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:55.294+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:56.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:56.250+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:56.331 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:56.326+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:57.238 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:57.230+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:57.327 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:57.322+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:58.283 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:58.278+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:58.349 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:58.342+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:23:59.317 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:23:59.310+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:23:59.347 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:23:59.342+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:00.339 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:00.334+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:00.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:00.386+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:01.304 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:01.298+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:01.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:01.406+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:02.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:02.326+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:02.428 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:02.422+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:03.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:03.286+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:03.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:03.382+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:04.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:04.310+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:04.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:04.374+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:05.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:05.342+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:05.374 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:05.370+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:06.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:06.326+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:06.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:06.338+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:07.325 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:07.318+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:07.393 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:07.386+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:08.354 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:08.346+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:08.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:08.362+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:09.332 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:09.326+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:09.389 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:09.382+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:10.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:10.374+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:10.397 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:10.390+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:11.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:11.346+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:11.428 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:11.422+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:12.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:12.394+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:12.429 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:12.422+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:13.449 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:13.438+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:13.475 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:13.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:14.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:14.390+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:14.481 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:14.474+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:15.358 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:15.350+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:15.434 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:15.426+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:16.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:16.306+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:16.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:16.418+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:17.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:17.270+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:17.382 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:17.374+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:18.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:18.250+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:18.406 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:18.398+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:19.215 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:19.210+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:19.443 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:19.438+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:20.201 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:20.194+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:20.469 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:20.462+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:21.177 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:21.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:21.452 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:21.446+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:22.216 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:22.210+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:22.447 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:22.442+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:23.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:23.234+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:23.495 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:23.490+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:24.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:24.266+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:24.510 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:24.506+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:25.271 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:25.266+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:25.505 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:25.498+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:26.284 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:26.278+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:26.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:26.530+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:27.320 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:27.314+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:27.532 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:27.526+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:28.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:28.330+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:28.514 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:28.510+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:29.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:29.298+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:29.488 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:29.482+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:30.260 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:30.254+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:30.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:30.434+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:31.217 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:31.210+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:31.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:31.426+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:32.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:32.234+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:32.445 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:32.438+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:33.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:33.230+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:33.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:33.450+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:34.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:34.190+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:34.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:34.434+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:35.224 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:35.218+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:35.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:35.458+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:36.183 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:36.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:36.480 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:36.474+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:37.213 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:37.206+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:37.475 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:37.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:38.258 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:38.254+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:38.509 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:38.502+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:39.273 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:39.266+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:39.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:39.550+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:40.238 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:40.230+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:40.510 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:40.506+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:41.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:41.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:41.492 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:41.486+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:42.187 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:42.182+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:42.516 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:42.510+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:43.146 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:43.142+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:43.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:43.530+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:44.185 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:44.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:44.508 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:44.502+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:45.225 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:45.210+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:45.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:45.534+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:46.240 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:46.234+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:46.547 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:46.542+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:47.216 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:47.210+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:47.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:47.554+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:48.251 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:48.246+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:48.584 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:48.578+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:49.257 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:49.250+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:49.588 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:49.582+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:50.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:50.266+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:50.554 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:50.550+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:51.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:51.310+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:51.590 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:51.586+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:52.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:52.342+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:52.566 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:52.562+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:53.324 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:53.318+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:53.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:53.534+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:54.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:54.326+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:54.492 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:54.486+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:55.327 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:55.322+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:55.477 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:55.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:56.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:56.346+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:56.484 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:56.478+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:57.335 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:57.330+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:57.506 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:57.502+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:58.338 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:58.334+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:58.481 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:58.474+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:24:59.346 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:24:59.342+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:24:59.476 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:24:59.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:00.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:00.370+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:00.469 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:00.462+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:01.330 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:01.326+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:01.477 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:01.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:02.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:02.350+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:02.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:02.434+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:03.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:03.378+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:03.394 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:03.390+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:04.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:04.374+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:04.409 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:04.402+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:05.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:05.406+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:05.438 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:05.434+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:06.427 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:06.422+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:06.490 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:06.482+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:07.438 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:07.430+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:07.477 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:07.470+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:08.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:08.438+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:08.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:08.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:09.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:09.446+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:09.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:09.474+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:10.444 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:10.438+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:10.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:10.446+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:11.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:11.414+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:11.462 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:11.458+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:12.426 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:12.422+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:12.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:12.506+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:13.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:13.418+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:13.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:13.466+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:14.394 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:14.390+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:14.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:14.426+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:15.368 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:15.362+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:15.440 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:15.434+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:16.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:16.406+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:16.452 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:16.446+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:17.413 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:17.406+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:17.426 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:17.422+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:18.425 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:18.418+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:18.447 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:18.442+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:19.422 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:19.418+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:19.432 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:19.426+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:20.405 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:20.398+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:20.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:20.434+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:21.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:21.394+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:21.432 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:21.426+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:22.359 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:22.354+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:22.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:22.430+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:23.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:23.394+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:23.481 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:23.474+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:24.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:24.370+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:24.524 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:24.518+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:25.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:25.330+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:25.517 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:25.510+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:26.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:26.358+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:26.523 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:26.518+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:27.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:27.358+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:27.533 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:27.526+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:28.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:28.346+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:28.568 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:28.562+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:29.398 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:29.390+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:29.580 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:29.574+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:30.347 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:30.342+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:30.583 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:30.578+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:31.344 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:31.338+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:31.582 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:31.578+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:32.361 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:32.354+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:32.616 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:32.610+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:33.361 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:33.354+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:33.660 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:33.654+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:34.361 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:34.354+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:34.621 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:34.614+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:35.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:35.310+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:35.583 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:35.578+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:36.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:36.302+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:36.613 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:36.606+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:37.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:37.290+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:37.610 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:37.606+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:38.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:38.314+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:38.597 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:38.590+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:39.370 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:39.366+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:39.593 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:39.586+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:40.381 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:40.374+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:40.582 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:40.574+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:41.335 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:41.330+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:41.547 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:41.542+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:42.343 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:42.338+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:42.540 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:42.534+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:43.342 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:43.338+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:43.532 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:43.526+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:44.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:44.290+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:44.504 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:44.498+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:45.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:45.258+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:45.496 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:45.490+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:46.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:46.302+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:46.488 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:46.482+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:47.307 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:47.302+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:47.460 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:47.454+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:48.313 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:48.306+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:48.419 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:48.414+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:49.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:49.326+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:49.437 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:49.430+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:50.358 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:50.354+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:50.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:50.450+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:51.378 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:51.374+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:51.447 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:51.442+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:52.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:52.386+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:52.429 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:52.422+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:53.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:53.394+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:53.470 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:53.466+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:54.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:54.430+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:54.510 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:54.506+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:55.466 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:55.462+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:55.470 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:55.466+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:56.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:56.450+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:56.491 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:56.486+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:57.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:57.446+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:57.537 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:57.530+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:58.459 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:58.454+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:58.545 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:58.538+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:25:59.452 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:25:59.446+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:25:59.528 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:25:59.522+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:00.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:00.418+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:00.574 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:00.570+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:01.437 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:01.430+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:01.620 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:01.614+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:02.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:02.458+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:02.642 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:02.638+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:03.444 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:03.438+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:03.599 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:03.594+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:04.467 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:04.462+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:04.607 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:04.602+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:05.478 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:05.474+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:05.597 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:05.590+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:06.475 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:06.470+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:06.559 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:06.554+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:07.472 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:07.466+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:07.601 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:07.594+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:08.482 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:08.474+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:08.634 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:08.626+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:09.525 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:09.518+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:09.680 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:09.674+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:10.523 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:10.518+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:10.639 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:10.634+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:11.511 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:11.506+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:11.620 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:11.614+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:12.492 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:12.486+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:12.671 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:12.666+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:13.536 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:13.530+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:13.703 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:13.698+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:14.536 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:14.530+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:14.659 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:14.654+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:15.521 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:15.514+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:15.650 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:15.646+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:16.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:16.502+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:16.619 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:16.610+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:17.535 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:17.530+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:17.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:17.582+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:18.534 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:18.530+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:18.571 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:18.566+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:19.525 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:19.518+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:19.547 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:19.542+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:20.570 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:20.566+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:20.588 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:20.582+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:21.572 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:21.566+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:21.631 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:21.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:22.584 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:22.578+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:22.643 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:22.638+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:23.552 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:23.546+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:23.672 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:23.666+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:24.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:24.598+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:24.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:24.650+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:25.588 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:25.582+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:25.696 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:25.690+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:26.557 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:26.550+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:26.702 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:26.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:27.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:27.586+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:27.708 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:27.702+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:28.624 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:28.618+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:28.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:28.702+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:29.637 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:29.630+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:29.676 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:29.670+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:30.673 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:30.666+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:30.686 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:30.682+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:31.653 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:31.646+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:31.710 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:31.706+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:32.681 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:32.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:32.730 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:32.726+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:33.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:33.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:33.755 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:33.750+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:34.722 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:34.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:34.754 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:34.750+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:35.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:35.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:35.804 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:35.798+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:36.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:36.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:36.797 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:36.790+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:37.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:37.729+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:37.847 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:37.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:38.777 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:38.769+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:38.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:38.821+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:39.797 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:39.789+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:39.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:39.817+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:40.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:40.809+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:40.854 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:40.849+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:41.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:41.825+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:41.846 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:41.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:42.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:42.817+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:42.843 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:42.837+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:43.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:43.809+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:43.868 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:43.861+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:44.780 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:44.773+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:44.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:44.817+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:45.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:45.745+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:45.814 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:45.805+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:46.764 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:46.757+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:46.860 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:46.853+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:47.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:47.737+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:47.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:47.869+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:48.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:48.785+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:48.904 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:48.897+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:49.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:49.777+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:49.889 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:49.881+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:50.787 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:50.781+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:50.872 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:50.865+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:51.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:51.777+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:51.886 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:51.881+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:52.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:52.809+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:52.862 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:52.857+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:53.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:53.853+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:53.913 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:53.905+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:54.860 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:54.853+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:54.882 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:54.877+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:55.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:55.849+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:55.866 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:55.861+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:56.812 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:56.809+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:56.860 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:56.857+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:57.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:57.801+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:57.881 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:57.873+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:58.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:58.793+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:58.880 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:58.873+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:26:59.807 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:26:59.805+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:26:59.891 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:26:59.889+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:00.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:00.781+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:00.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:00.897+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:01.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:01.797+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:01.933 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:01.933+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:02.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:02.781+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:02.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:02.909+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:03.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:03.745+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:03.877 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:03.873+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:04.721 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:04.717+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:04.840 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:04.837+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:05.675 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:05.673+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:05.805 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:05.801+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:06.683 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:06.681+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:06.843 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:06.841+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:07.734 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:07.733+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:07.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:07.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:08.737 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:08.733+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:08.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:08.789+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:09.731 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:09.729+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:09.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:09.793+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:10.770 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:10.769+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:10.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:10.789+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:11.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:11.789+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:11.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:11.801+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:12.759 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:12.757+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:12.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:12.833+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:13.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:13.733+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:13.853 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:13.853+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:14.786 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:14.785+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:14.863 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:14.861+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:15.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:15.833+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:15.845 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:15.841+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:16.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:16.849+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:16.877 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:16.877+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:17.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:17.889+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:17.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:17.897+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:18.922 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:18.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:18.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:18.945+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:19.911 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:19.909+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:19.986 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:19.985+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:20.883 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:20.881+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:20.966 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:20.965+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:21.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:21.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:21.971 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:21.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:22.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:22.933+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:22.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:22.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:23.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:23.925+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:23.954 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:23.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:24.962 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:24.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:24.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:24.973+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:25.921 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:25.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:25.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:25.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:26.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:26.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:26.952 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:26.949+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:27.906 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:27.905+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:27.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:27.941+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:28.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:28.901+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:28.957 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:28.953+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:29.873 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:29.869+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:29.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:29.913+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:30.871 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:30.869+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:30.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:30.889+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:31.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:31.845+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:31.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:31.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:32.862 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:32.861+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:32.962 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:32.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:33.820 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:33.817+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:33.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:33.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:34.854 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:34.853+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:34.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:34.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:35.885 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:35.881+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:35.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:35.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:36.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:36.897+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:36.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:36.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:37.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:37.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:37.927 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:37.925+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:38.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:38.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:38.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:38.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:39.941 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:39.937+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:39.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:39.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:40.925 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:40.921+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:40.984 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:40.981+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:41.885 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:41.881+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:41.942 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:41.941+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:42.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:42.933+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:42.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:42.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:43.901 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:43.897+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:43.971 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:43.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:44.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:44.897+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:44.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:44.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:45.931 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:45.929+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:45.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:45.937+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:46.905 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:46.901+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:46.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:46.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:47.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:47.913+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:47.962 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:47.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:48.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:48.881+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:49.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:49.005+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:49.902 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:49.901+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:50.051 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:50.049+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:50.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:50.857+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:51.078 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:51.077+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:51.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:51.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:52.086 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:52.085+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:52.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:52.805+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:53.136 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:53.133+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:53.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:53.777+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:54.177 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:54.177+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:54.753 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:54.749+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:55.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:55.209+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:55.771 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:55.769+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:56.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:56.185+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:56.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:56.733+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:57.165 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:57.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:57.721 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:57.717+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:58.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:58.185+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:58.699 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:58.697+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:27:59.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:27:59.185+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:27:59.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:27:59.725+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:00.163 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:00.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:00.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:00.749+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:01.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:01.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:01.788 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:01.785+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:02.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:02.125+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:02.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:02.801+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:03.160 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:03.157+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:03.767 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:03.765+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:04.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:04.129+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:04.802 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:04.801+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:05.128 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:05.125+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:05.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:05.841+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:06.156 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:06.153+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:06.833 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:06.829+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:07.123 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:07.121+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:07.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:07.837+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:08.147 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:08.145+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:08.859 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:08.857+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:09.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:09.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:09.860 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:09.857+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:10.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:10.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:10.829 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:10.825+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:11.078 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:11.077+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:11.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:11.805+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:12.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:12.053+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:12.812 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:12.809+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:13.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:13.061+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:13.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:13.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:14.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:14.065+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:14.771 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:14.769+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:15.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:15.085+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:15.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:15.733+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:16.131 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:16.129+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:16.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:16.725+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:17.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:17.177+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:17.758 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:17.757+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:18.136 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:18.133+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:18.771 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:18.769+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:19.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:19.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:19.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:19.793+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:20.200 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:20.197+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:20.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:20.757+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:21.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:21.189+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:21.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:21.753+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:22.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:22.209+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:22.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:22.737+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:23.240 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:23.237+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:23.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:23.781+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:24.244 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:24.241+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:24.746 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:24.745+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:25.288 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:25.285+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:25.752 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:25.749+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:26.287 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:26.285+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:26.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:26.717+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:27.239 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:27.237+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:27.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:27.765+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:28.290 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:28.289+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:28.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:28.801+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:29.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:29.285+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:29.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:29.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:30.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:30.317+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:30.860 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:30.857+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:31.342 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:31.341+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:31.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:31.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:32.316 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:32.313+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:32.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:32.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:33.272 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:33.269+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:33.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:33.797+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:34.278 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:34.277+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:34.762 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:34.761+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:35.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:35.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:35.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:35.777+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:36.320 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:36.317+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:36.749 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:36.749+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:37.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:37.333+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:37.754 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:37.753+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:38.289 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:38.285+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:38.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:38.745+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:39.300 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:39.297+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:39.752 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:39.749+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:40.307 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:40.305+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:40.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:40.705+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:41.261 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:41.261+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:41.729 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:41.725+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:42.215 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:42.213+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:42.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:42.737+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:43.204 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:43.201+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:43.772 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:43.769+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:44.177 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:44.173+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:44.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:44.777+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:45.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:45.193+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:45.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:45.805+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:46.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:46.209+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:46.843 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:46.841+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:47.263 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:47.261+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:47.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:47.869+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:48.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:48.253+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:48.866 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:48.865+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:49.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:49.305+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:49.839 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:49.837+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:50.279 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:50.277+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:50.860 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:50.857+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:51.260 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:51.257+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:51.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:51.829+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:52.235 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:52.233+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:52.862 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:52.861+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:53.205 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:53.205+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:53.874 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:53.873+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:54.173 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:54.169+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:54.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:54.829+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:55.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:55.185+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:55.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:55.829+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:56.219 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:56.217+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:56.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:56.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:57.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:57.185+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:57.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:57.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:58.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:58.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:58.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:58.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:28:59.190 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:28:59.189+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:28:59.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:28:59.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:00.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:00.193+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:00.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:00.805+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:01.215 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:01.213+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:01.806 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:01.805+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:02.228 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:02.225+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:02.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:02.773+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:03.225 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:03.221+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:03.728 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:03.725+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:04.177 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:04.177+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:04.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:04.705+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:05.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:05.189+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:05.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:05.753+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:06.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:06.229+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:06.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:06.737+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:07.232 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:07.229+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:07.728 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:07.725+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:08.263 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:08.261+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:08.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:08.741+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:09.261 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:09.257+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:09.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:09.737+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:10.273 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:10.269+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:10.752 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:10.749+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:11.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:11.261+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:11.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:11.789+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:12.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:12.289+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:12.820 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:12.817+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:13.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:13.321+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:13.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:13.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:14.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:14.305+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:14.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:14.853+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:15.279 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:15.277+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:15.903 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:15.901+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:16.310 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:16.308+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:16.946 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:16.944+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:17.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:17.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:17.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:17.984+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:18.278 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:18.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:19.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:19.008+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:19.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:19.228+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:20.047 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:20.044+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:20.238 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:20.236+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:21.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:21.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:21.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:21.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:22.047 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:22.044+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:22.251 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:22.248+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:23.064 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:23.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:23.294 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:23.292+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:24.099 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:24.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:24.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:24.248+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:25.058 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:25.056+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:25.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:25.268+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:26.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:26.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:26.222 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:26.220+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:27.135 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:27.132+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:27.216 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:27.212+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:28.159 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:28.156+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:28.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:28.168+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:29.143 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:29.140+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:29.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:29.176+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:30.163 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:30.160+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:30.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:30.164+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:31.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:31.124+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:31.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:31.172+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:32.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:32.084+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:32.171 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:32.168+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:33.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:33.072+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:33.166 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:33.164+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:34.060 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:34.056+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:34.165 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:34.160+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:35.099 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:35.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:35.196 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:35.192+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:36.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:36.100+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:36.163 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:36.160+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:37.115 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:37.112+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:37.140 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:37.136+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:38.104 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:38.100+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:38.110 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:38.108+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:39.059 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:39.056+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:39.096 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:39.092+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:40.090 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:40.088+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:40.107 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:40.104+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:41.128 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:41.124+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:41.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:41.128+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:42.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:42.088+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:42.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:42.100+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:43.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:43.068+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:43.119 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:43.116+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:44.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:44.052+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:44.148 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:44.144+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:45.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:45.068+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:45.162 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:45.160+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:46.060 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:46.056+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:46.184 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:46.180+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:47.052 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:47.048+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:47.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:47.188+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:48.040 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:48.036+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:48.179 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:48.176+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:49.050 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:49.048+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:49.215 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:49.212+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:50.005 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:50.000+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:50.227 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:50.224+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:50.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:50.976+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:51.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:51.184+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:51.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:51.976+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:52.158 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:52.156+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:52.989 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:52.984+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:53.158 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:53.156+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:54.004 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:54.000+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:54.120 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:54.116+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:55.046 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:55.044+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:55.098 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:55.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:56.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:56.044+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:56.137 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:56.132+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:57.052 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:57.048+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:57.174 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:57.172+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:58.040 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:58.036+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:58.149 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:58.144+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:29:59.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:29:59.088+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:29:59.200 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:29:59.196+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:00.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:00.116+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:00.176 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:00.172+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:01.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:01.152+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:01.196 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:01.192+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:02.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:02.188+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:02.219 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:02.216+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:03.149 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:03.148+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:03.184 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:03.180+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:04.110 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:04.108+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:04.218 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:04.216+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:05.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:05.100+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:05.268 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:05.264+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:06.063 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:06.060+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:06.287 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:06.284+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:07.036 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:07.032+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:07.317 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:07.312+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:08.038 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:08.036+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:08.301 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:08.300+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:09.054 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:09.052+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:09.313 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:09.312+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:10.044 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:10.040+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:10.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:10.340+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:11.029 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:11.028+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:11.343 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:11.340+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:12.010 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:12.008+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:12.320 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:12.316+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:12.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:12.960+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:13.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:13.368+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:13.921 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:13.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:14.414 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:14.412+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:14.923 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:14.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:15.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:15.400+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:15.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:15.960+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:16.404 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:16.400+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:16.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:16.988+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:17.372 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:17.368+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:18.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:18.032+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:18.339 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:18.336+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:19.059 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:19.056+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:19.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:19.340+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:20.064 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:20.060+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:20.365 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:20.364+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:21.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:21.056+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:21.371 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:21.368+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:22.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:22.072+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:22.413 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:22.408+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:23.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:23.068+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:23.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:23.436+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:24.050 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:24.048+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:24.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:24.420+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:25.081 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:25.080+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:25.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:25.420+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:26.053 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:26.048+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:26.395 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:26.392+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:27.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:27.084+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:27.433 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:27.432+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:28.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:28.040+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:28.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:28.460+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:29.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:29.008+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:29.472 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:29.468+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:30.061 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:30.056+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:30.472 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:30.468+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:31.056 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:31.052+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:31.511 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:31.508+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:32.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:32.100+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:32.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:32.496+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:33.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:33.128+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:33.543 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:33.540+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:34.114 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:34.112+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:34.583 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:34.580+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:35.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:35.068+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:35.546 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:35.544+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:36.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:36.092+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:36.515 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:36.512+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:37.050 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:37.048+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:37.475 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:37.472+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:38.061 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:38.060+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:38.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:38.524+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:39.090 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:39.088+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:39.508 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:39.504+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:40.061 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:40.060+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:40.518 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:40.516+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:41.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:41.056+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:41.483 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:41.480+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:42.082 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:42.080+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:42.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:42.432+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:43.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:43.032+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:43.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:43.400+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:44.063 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:44.060+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:44.424 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:44.420+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:45.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:45.044+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:45.464 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:45.460+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:46.094 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:46.092+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:46.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:46.436+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:47.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:47.128+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:47.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:47.432+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:48.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:48.140+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:48.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:48.436+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:49.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:49.184+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:49.423 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:49.420+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:50.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:50.192+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:50.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:50.432+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:51.224 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:51.220+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:51.418 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:51.416+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:52.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:52.268+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:52.414 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:52.412+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:53.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:53.304+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:53.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:53.404+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:54.343 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:54.340+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:54.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:54.452+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:55.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:55.348+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:55.488 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:55.484+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:56.321 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:56.316+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:56.469 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:56.468+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:57.365 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:57.364+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:57.515 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:57.512+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:58.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:58.360+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:58.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:58.464+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:30:59.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:30:59.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:30:59.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:30:59.460+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:00.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:00.392+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:00.473 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:00.468+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:01.355 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:01.352+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:01.471 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:01.468+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:02.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:02.368+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:02.494 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:02.492+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:03.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:03.348+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:03.504 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:03.500+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:04.362 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:04.360+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:04.469 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:04.468+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:05.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:05.316+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:05.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:05.496+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:06.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:06.304+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:06.523 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:06.520+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:07.274 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:07.272+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:07.566 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:07.564+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:08.320 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:08.316+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:08.609 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:08.608+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:09.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:09.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:09.623 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:09.620+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:10.267 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:10.264+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:10.638 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:10.636+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:11.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:11.232+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:11.599 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:11.596+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:12.283 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:12.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:12.564 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:12.560+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:13.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:13.308+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:13.517 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:13.512+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:14.274 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:14.272+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:14.543 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:14.540+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:15.265 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:15.264+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:15.580 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:15.576+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:16.223 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:16.220+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:16.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:16.556+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:17.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:17.180+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:17.549 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:17.548+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:18.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:18.180+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:18.515 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:18.512+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:19.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:19.208+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:19.563 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:19.560+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:20.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:20.208+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:20.584 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:20.580+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:21.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:21.192+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:21.620 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:21.616+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:22.174 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:22.172+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:22.643 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:22.640+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:23.208 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:23.204+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:23.663 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:23.660+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:24.240 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:24.236+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:24.694 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:24.692+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:25.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:25.188+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:25.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:25.736+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:26.223 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:26.220+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:26.695 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:26.692+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:27.201 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:27.200+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:27.695 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:27.692+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:28.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:28.172+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:28.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:28.724+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:29.226 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:29.224+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:29.722 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:29.720+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:30.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:30.188+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:30.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:30.680+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:31.157 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:31.152+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:31.646 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:31.644+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:32.156 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:32.152+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:32.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:32.624+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:33.154 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:33.152+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:33.607 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:33.604+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:34.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:34.156+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:34.596 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:34.592+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:35.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:35.184+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:35.592 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:35.588+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:36.234 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:36.232+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:36.562 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:36.560+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:37.228 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:37.224+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:37.578 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:37.576+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:38.263 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:38.260+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:38.611 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:38.608+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:39.245 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:39.244+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:39.591 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:39.587+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:40.265 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:40.263+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:40.614 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:40.611+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:41.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:41.287+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:41.642 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:41.639+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:42.266 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:42.263+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:42.664 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:42.659+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:43.223 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:43.219+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:43.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:43.623+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:44.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:44.207+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:44.665 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:44.663+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:45.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:45.179+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:45.709 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:45.707+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:46.154 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:46.151+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:46.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:46.731+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:47.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:47.167+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:47.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:47.739+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:48.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:48.207+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:48.724 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:48.719+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:49.207 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:49.203+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:49.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:49.755+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:50.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:50.235+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:50.770 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:50.767+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:51.267 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:51.263+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:51.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:51.771+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:52.239 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:52.235+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:52.772 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:52.767+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:53.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:53.215+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:53.754 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:53.751+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:54.199 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:54.195+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:54.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:54.711+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:55.241 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:55.239+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:55.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:55.739+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:56.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:56.251+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:56.787 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:56.783+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:57.241 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:57.235+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:57.780 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:57.775+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:58.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:58.195+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:58.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:58.811+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:31:59.228 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:31:59.223+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:31:59.863 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:31:59.859+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:00.193 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:00.191+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:00.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:00.811+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:01.245 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:01.243+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:01.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:01.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:02.223 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:02.219+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:02.799 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:02.795+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:03.261 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:03.259+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:03.829 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:03.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:04.299 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:04.295+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:04.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:04.799+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:05.299 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:05.295+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:05.780 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:05.775+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:06.340 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:06.335+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:06.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:06.795+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:07.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:07.351+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:07.845 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:07.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:08.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:08.331+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:08.875 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:08.871+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:09.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:09.327+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:09.845 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:09.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:10.346 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:10.343+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:10.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:10.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:11.328 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:11.323+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:11.854 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:11.851+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:12.293 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:12.291+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:12.874 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:12.871+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:13.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:13.271+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:13.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:13.887+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:14.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:14.283+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:14.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:14.867+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:15.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:15.311+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:15.869 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:15.867+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:16.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:16.347+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:16.913 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:16.911+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:17.373 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:17.371+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:17.885 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:17.883+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:18.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:18.343+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:18.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:18.927+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:19.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:19.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:19.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:19.979+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:20.431 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:20.427+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:20.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:20.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:21.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:21.431+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:21.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:21.911+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:22.474 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:22.471+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:22.921 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:22.919+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:23.495 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:23.491+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:23.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:23.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:24.465 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:24.463+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:24.994 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:24.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:25.489 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:25.483+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:25.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:25.987+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:26.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:26.523+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:26.985 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:26.979+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:27.489 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:27.487+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:28.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:27.999+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:28.468 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:28.463+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:28.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:28.963+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:29.475 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:29.471+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:30.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:29.999+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:30.494 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:30.491+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:31.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:31.011+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:31.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:31.467+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:31.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:31.983+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:32.426 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:32.423+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:32.941 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:32.939+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:33.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:33.379+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:33.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:33.983+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:34.338 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:34.335+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:34.951 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:34.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:35.378 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:35.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:35.912 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:35.907+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:36.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:36.379+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:36.880 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:36.875+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:37.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:37.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:37.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:37.887+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:38.332 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:38.327+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:38.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:38.879+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:39.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:39.331+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:39.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:39.851+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:40.300 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:40.295+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:40.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:40.875+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:41.300 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:41.295+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:41.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:41.903+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:42.302 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:42.299+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:42.948 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:42.943+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:43.297 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:43.295+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:43.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:43.943+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:44.305 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:44.299+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:44.905 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:44.899+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:45.343 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:45.339+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:45.860 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:45.855+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:46.367 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:46.363+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:46.869 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:46.867+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:47.415 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:47.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:47.885 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:47.883+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:48.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:48.399+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:48.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:48.851+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:49.369 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:49.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:49.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:49.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:50.334 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:50.331+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:50.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:50.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:51.338 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:51.335+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:51.862 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:51.859+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:52.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:52.383+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:52.879 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:52.875+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:53.416 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:53.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:53.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:53.903+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:54.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:54.403+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:54.885 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:54.883+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:55.445 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:55.439+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:55.881 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:55.875+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:56.411 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:56.407+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:56.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:56.923+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:57.414 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:57.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:57.961 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:57.955+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:58.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:58.415+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:32:58.952 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:58.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:32:59.394 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:32:59.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:00.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:32:59.999+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:00.370 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:00.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:00.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:00.963+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:01.404 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:01.399+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:01.993 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:01.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:02.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:02.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:03.010 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:03.007+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:03.383 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:03.379+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:04.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:04.011+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:04.349 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:04.347+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:05.038 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:05.035+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:05.399 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:05.395+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:06.034 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:06.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:06.363 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:06.359+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:07.035 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:07.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:07.415 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:07.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:08.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:08.035+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:08.444 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:08.439+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:09.045 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:09.043+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:09.455 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:09.451+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:10.052 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:10.047+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:10.452 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:10.447+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:11.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:11.079+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:11.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:11.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:12.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:12.079+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:12.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:12.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:13.038 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:13.035+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:13.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:13.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:14.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:14.079+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:14.449 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:14.447+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:15.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:15.063+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:15.489 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:15.487+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:16.090 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:16.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:16.462 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:16.459+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:17.083 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:17.079+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:17.416 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:17.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:18.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:18.115+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:18.419 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:18.415+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:19.161 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:19.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:19.452 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:19.447+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:20.167 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:20.163+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:20.489 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:20.487+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:21.131 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:21.127+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:21.505 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:21.499+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:22.165 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:22.159+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:22.542 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:22.539+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:23.212 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:23.207+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:23.545 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:23.543+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:24.256 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:24.251+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:24.549 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:24.543+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:25.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:25.267+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:25.520 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:25.515+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:26.291 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:26.287+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:26.544 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:26.539+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:27.253 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:27.251+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:27.590 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:27.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:28.230 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:28.227+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:28.612 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:28.607+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:29.222 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:29.219+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:29.591 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:29.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:30.234 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:30.231+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:30.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:30.563+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:31.267 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:31.263+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:31.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:31.535+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:32.257 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:32.255+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:32.565 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:32.563+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:33.274 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:33.271+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:33.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:33.591+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:34.262 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:34.259+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:34.561 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:34.559+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:35.289 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:35.287+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:35.557 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:35.555+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:36.305 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:36.303+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:36.522 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:36.519+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:37.278 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:37.275+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:37.568 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:37.563+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:38.306 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:38.303+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:38.568 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:38.563+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:39.318 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:39.315+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:39.609 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:39.607+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:40.312 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:40.307+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:40.639 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:40.635+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:41.342 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:41.339+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:41.684 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:41.679+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:42.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:42.379+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:42.719 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:42.715+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:43.406 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:43.403+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:43.720 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:43.715+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:44.368 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:44.363+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:44.711 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:44.707+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:45.404 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:45.399+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:45.704 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:45.699+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:46.448 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:46.443+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:46.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:46.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:47.413 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:47.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:47.651 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:47.643+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:48.377 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:48.375+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:48.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:48.611+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:49.400 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:49.395+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:49.583 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:49.579+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:50.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:50.371+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:50.547 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:50.543+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:51.404 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:51.399+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:51.567 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:51.563+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:52.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:52.399+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:52.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:52.559+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:53.453 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:53.451+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:53.550 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:53.547+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:54.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:54.462+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:54.586 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:54.582+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:55.497 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:55.490+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:55.632 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:55.626+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:56.492 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:56.486+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:56.622 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:56.618+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:57.493 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:57.490+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:57.579 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:57.574+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:58.518 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:58.514+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:58.623 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:58.618+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:33:59.517 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:33:59.514+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:33:59.636 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:33:59.630+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:00.540 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:00.538+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:00.624 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:00.618+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:01.517 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:01.514+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:01.621 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:01.618+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:02.494 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:02.490+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:02.620 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:02.614+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:03.459 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:03.454+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:03.583 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:03.578+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:04.444 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:04.438+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:04.556 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:04.550+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:05.442 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:05.438+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:05.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:05.534+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:06.486 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:06.482+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:06.528 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:06.522+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:07.511 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:07.506+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:07.544 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:07.538+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:08.524 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:08.518+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:08.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:08.522+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:09.546 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:09.542+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:09.552 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:09.546+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:10.568 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:10.562+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:10.569 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:10.566+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:11.573 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:11.570+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:11.612 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:11.606+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:12.548 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:12.542+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:12.609 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:12.606+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:13.506 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:13.502+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:13.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:13.558+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:14.513 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:14.510+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:14.546 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:14.542+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:15.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:15.522+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:15.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:15.590+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:16.519 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:16.514+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:16.570 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:16.566+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:17.543 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:17.538+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:17.558 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:17.554+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:18.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:18.522+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:18.579 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:18.574+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:19.518 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:19.514+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:19.578 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:19.574+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:20.512 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:20.506+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:20.602 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:20.598+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:21.527 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:21.522+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:21.561 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:21.558+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:22.535 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:22.530+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:22.567 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:22.562+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:23.499 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:23.494+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:23.552 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:23.546+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:24.489 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:24.486+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:24.551 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:24.546+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:25.494 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:25.490+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:25.587 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:25.582+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:26.538 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:26.534+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:26.621 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:26.614+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:27.530 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:27.526+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:27.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:27.630+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:28.534 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:28.530+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:28.591 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:28.586+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:29.553 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:29.550+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:29.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:29.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:30.558 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:30.554+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:30.596 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:30.590+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:31.580 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:31.574+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:31.645 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:31.642+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:32.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:32.562+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:32.617 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:32.614+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:33.551 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:33.546+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:33.627 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:33.622+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:34.562 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:34.558+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:34.620 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:34.614+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:35.601 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:35.598+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:35.651 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:35.646+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:36.560 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:36.554+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:36.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:36.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:37.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:37.598+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:37.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:37.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:38.592 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:38.586+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:38.652 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:38.646+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:39.593 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:39.590+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:39.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:39.610+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:40.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:40.570+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:40.652 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:40.646+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:41.620 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:41.614+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:41.669 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:41.666+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:42.581 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:42.578+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:42.701 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:42.698+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:43.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:43.554+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:43.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:43.702+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:44.587 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:44.582+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:44.723 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:44.718+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:45.597 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:45.594+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:45.699 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:45.694+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:46.596 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:46.590+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:46.704 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:46.698+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:47.640 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:47.634+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:47.755 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:47.750+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:48.598 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:48.594+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:48.792 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:48.786+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:49.573 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:49.570+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:49.790 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:49.786+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:50.562 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:50.558+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:50.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:50.790+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:51.550 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:51.546+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:51.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:51.818+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:52.510 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:52.506+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:52.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:52.850+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:53.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:53.538+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:53.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:53.830+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:54.578 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:54.574+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:54.885 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:54.882+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:55.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:55.622+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:55.935 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:55.930+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:56.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:56.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:56.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:56.962+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:57.692 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:57.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:57.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:57.974+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:58.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:58.670+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:59.019 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:59.014+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:34:59.709 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:34:59.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:34:59.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:34:59.978+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:00.708 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:00.702+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:00.977 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:00.974+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:01.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:01.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:01.942 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:01.938+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:02.652 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:02.646+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:02.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:02.942+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:03.668 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:03.666+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:03.922 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:03.918+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:04.686 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:04.682+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:04.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:04.962+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:05.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:05.666+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:05.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:05.954+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:06.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:06.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:06.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:06.966+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:07.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:07.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:07.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:07.950+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:08.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:08.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:08.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:08.938+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:09.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:09.662+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:09.937 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:09.934+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:10.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:10.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:10.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:10.962+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:11.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:11.758+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:11.946 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:11.942+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:12.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:12.790+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:12.924 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:12.918+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:13.818 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:13.814+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:13.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:13.890+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:14.806 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:14.802+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:14.857 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:14.854+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:15.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:15.782+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:15.826 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:15.822+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:16.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:16.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:16.795 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:16.790+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:17.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:17.726+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:17.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:17.830+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:18.736 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:18.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:18.788 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:18.782+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:19.692 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:19.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:19.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:19.810+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:20.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:20.662+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:20.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:20.786+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:21.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:21.694+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:21.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:21.822+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:22.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:22.650+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:22.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:22.790+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:23.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:23.662+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:23.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:23.814+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:24.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:24.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:24.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:24.790+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:25.597 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:25.594+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:25.757 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:25.754+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:26.622 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:26.618+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:26.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:26.778+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:27.639 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:27.634+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:27.743 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:27.738+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:28.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:28.662+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:28.722 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:28.718+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:29.690 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:29.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:29.747 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:29.742+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:30.653 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:30.650+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:30.757 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:30.754+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:31.623 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:31.618+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:31.771 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:31.766+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:32.578 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:32.574+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:32.725 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:32.722+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:33.565 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:33.562+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:33.694 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:33.690+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:34.540 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:34.534+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:34.713 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:34.706+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:35.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:35.554+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:35.752 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:35.746+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:36.573 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:36.570+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:36.750 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:36.746+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:37.603 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:37.598+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:37.768 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:37.762+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:38.572 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:38.566+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:38.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:38.802+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:39.565 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:39.562+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:39.776 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:39.770+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:40.534 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:40.530+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:40.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:40.778+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:41.553 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:41.550+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:41.800 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:41.794+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:42.595 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:42.590+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:42.821 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:42.818+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:43.619 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:43.614+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:43.860 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:43.854+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:44.644 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:44.638+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:44.888 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:44.882+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:45.597 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:45.594+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:45.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:45.870+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:46.621 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:46.618+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:46.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:46.850+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:47.594 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:47.590+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:47.839 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:47.834+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:48.573 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:48.570+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:48.807 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:48.802+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:49.589 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:49.586+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:49.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:49.794+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:50.589 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:50.582+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:50.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:50.822+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:51.589 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:51.586+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:51.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:51.798+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:52.565 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:52.562+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:52.828 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:52.822+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:53.594 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:53.590+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:53.842 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:53.838+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:54.638 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:54.634+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:54.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:54.854+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:55.678 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:55.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:55.843 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:55.838+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:56.633 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:56.630+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:56.888 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:56.882+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:57.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:57.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:57.902 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:57.898+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:58.709 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:58.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:58.886 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:58.882+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:35:59.714 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:35:59.710+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:35:59.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:35:59.914+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:00.727 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:00.722+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:00.943 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:00.938+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:01.688 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:01.682+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:01.987 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:01.982+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:02.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:02.713+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:03.005 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:03.001+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:03.764 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:03.757+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:03.977 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:03.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:04.727 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:04.721+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:04.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:04.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:05.713 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:05.709+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:05.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:05.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:06.686 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:06.681+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:06.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:06.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:07.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:07.705+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:07.977 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:07.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:08.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:08.661+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:08.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:08.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:09.664 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:09.657+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:09.947 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:09.941+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:10.689 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:10.685+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:10.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:10.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:11.685 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:11.681+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:11.939 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:11.933+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:12.676 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:12.669+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:12.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:12.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:13.650 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:13.645+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:13.942 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:13.937+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:14.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:14.665+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:14.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:14.929+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:15.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:15.645+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:15.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:15.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:16.603 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:16.601+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:16.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:16.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:17.650 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:17.649+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:17.983 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:17.977+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:18.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:18.677+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:18.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:18.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:19.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:19.665+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:19.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:19.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:20.660 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:20.657+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:20.924 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:20.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:21.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:21.677+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:21.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:21.929+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:22.676 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:22.673+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:22.930 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:22.929+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:23.686 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:23.685+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:23.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:23.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:24.728 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:24.725+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:24.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:24.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:25.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:25.701+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:25.998 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:25.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:26.728 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:26.725+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:26.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:26.977+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:27.734 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:27.733+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:27.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:27.933+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:28.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:28.709+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:28.934 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:28.933+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:29.665 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:29.665+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:29.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:29.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:30.681 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:30.681+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:30.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:30.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:31.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:31.673+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:31.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:31.873+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:32.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:32.645+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:32.919 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:32.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:33.602 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:33.601+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:33.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:33.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:34.574 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:34.573+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:35.012 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:35.009+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:35.569 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:35.569+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:36.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:36.025+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:36.548 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:36.545+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:37.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:37.033+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:37.503 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:37.501+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:38.073 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:38.073+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:38.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:38.465+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:39.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:39.045+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:39.428 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:39.425+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:40.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:40.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:40.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:40.433+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:41.017 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:41.017+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:41.403 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:41.401+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:42.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:42.041+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:42.401 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:42.397+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:43.031 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:43.029+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:43.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:43.357+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:44.005 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:44.005+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:44.408 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:44.405+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:45.029 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:45.029+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:45.398 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:45.397+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:46.053 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:46.053+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:46.386 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:46.385+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:47.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:47.085+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:47.405 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:47.401+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:48.129 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:48.129+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:48.371 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:48.369+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:49.172 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:49.169+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:49.353 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:49.349+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:50.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:50.129+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:50.372 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:50.373+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:51.104 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:51.101+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:51.332 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:51.329+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:52.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:52.065+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:52.340 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:52.337+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:53.110 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:53.109+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:53.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:53.377+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:54.140 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:54.137+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:54.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:54.341+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:55.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:55.093+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:55.336 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:55.333+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:56.118 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:56.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:56.382 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:56.381+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:57.154 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:57.153+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:57.371 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:57.369+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:58.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:58.137+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:58.409 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:58.409+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:36:59.157 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:36:59.157+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:36:59.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:36:59.437+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:00.131 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:00.129+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:00.394 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:00.393+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:01.149 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:01.149+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:01.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:01.389+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:02.196 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:02.193+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:02.355 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:02.353+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:03.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:03.197+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:03.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:03.309+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:04.205 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:04.205+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:04.353 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:04.353+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:05.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:05.197+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:05.329 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:05.329+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:06.247 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:06.245+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:06.339 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:06.337+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:07.213 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:07.213+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:07.363 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:07.361+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:08.218 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:08.217+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:08.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:08.357+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:09.177 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:09.177+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:09.323 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:09.321+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:10.224 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:10.221+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:10.366 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:10.365+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:11.258 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:11.257+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:11.321 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:11.321+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:12.275 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:12.273+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:12.313 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:12.313+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:13.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:13.237+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:13.321 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:13.321+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:14.283 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:14.281+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:14.321 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:14.321+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:15.303 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:15.301+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:15.328 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:15.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:16.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:16.285+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:16.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:16.293+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:17.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:17.285+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:17.325 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:17.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:18.263 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:18.261+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:18.343 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:18.341+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:19.269 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:19.269+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:19.349 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:19.349+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:20.264 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:20.261+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:20.365 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:20.365+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:21.239 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:21.237+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:21.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:21.393+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:22.257 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:22.257+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:22.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:22.401+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:23.278 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:23.277+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:23.426 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:23.425+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:24.322 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:24.321+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:24.419 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:24.417+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:25.310 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:25.309+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:25.421 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:25.421+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:26.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:26.285+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:26.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:26.421+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:27.247 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:27.245+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:27.457 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:27.457+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:28.256 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:28.253+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:28.430 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:28.429+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:29.212 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:29.209+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:29.394 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:29.393+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:30.204 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:30.201+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:30.425 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:30.425+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:31.200 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:31.197+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:31.461 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:31.461+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:32.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:32.209+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:32.434 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:32.433+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:33.244 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:33.241+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:33.402 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:33.401+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:34.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:34.269+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:34.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:34.441+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:35.299 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:35.297+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:35.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:35.481+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:36.283 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:36.281+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:36.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:36.433+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:37.283 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:37.281+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:37.421 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:37.421+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:38.313 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:38.313+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:38.448 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:38.445+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:39.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:39.341+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:39.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:39.397+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:40.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:40.361+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:40.405 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:40.405+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:41.370 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:41.369+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:41.450 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:41.449+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:42.358 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:42.357+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:42.454 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:42.453+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:43.354 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:43.353+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:43.445 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:43.444+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:44.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:44.384+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:44.464 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:44.460+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:45.383 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:45.380+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:45.462 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:45.460+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:46.409 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:46.408+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:46.416 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:46.412+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:47.375 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:47.372+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:47.446 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:47.444+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:48.408 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:48.404+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:48.466 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:48.464+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:49.447 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:49.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:49.503 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:49.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:50.460 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:50.456+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:50.506 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:50.504+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:51.447 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:51.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:51.497 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:51.496+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:52.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:52.408+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:52.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:52.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:53.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:53.432+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:53.445 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:53.440+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:54.414 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:54.412+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:54.484 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:54.480+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:55.389 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:55.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:55.525 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:55.524+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:56.363 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:56.360+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:56.557 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:56.556+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:57.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:57.368+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:57.535 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:57.532+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:58.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:58.348+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:58.494 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:58.492+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:37:59.321 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:37:59.320+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:37:59.510 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:37:59.508+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:00.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:00.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:00.484 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:00.480+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:01.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:01.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:01.536 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:01.532+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:02.335 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:02.332+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:02.527 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:02.524+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:03.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:03.368+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:03.569 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:03.568+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:04.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:04.404+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:04.601 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:04.600+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:05.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:05.372+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:05.635 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:05.632+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:06.409 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:06.408+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:06.627 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:06.624+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:07.426 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:07.424+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:07.626 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:07.624+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:08.446 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:08.444+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:08.600 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:08.596+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:09.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:09.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:09.587 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:09.584+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:10.451 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:10.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:10.544 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:10.540+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:11.409 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:11.408+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:11.549 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:11.548+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:12.426 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:12.424+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:12.599 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:12.596+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:13.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:13.400+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:13.602 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:13.600+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:14.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:14.428+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:14.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:14.604+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:15.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:15.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:15.619 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:15.616+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:16.484 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:16.480+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:16.639 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:16.636+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:17.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:17.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:17.629 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:17.628+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:18.407 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:18.404+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:18.658 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:18.656+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:19.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:19.432+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:19.649 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:19.648+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:20.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:20.436+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:20.678 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:20.676+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:21.392 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:21.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:21.637 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:21.632+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:22.379 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:22.376+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:22.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:22.676+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:23.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:23.392+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:23.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:23.708+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:24.421 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:24.420+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:24.727 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:24.724+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:25.392 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:25.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:25.693 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:25.692+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:26.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:26.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:26.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:26.680+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:27.410 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:27.408+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:27.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:27.696+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:28.425 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:28.424+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:28.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:28.700+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:29.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:29.468+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:29.709 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:29.708+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:30.514 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:30.512+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:30.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:30.736+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:31.498 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:31.496+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:31.770 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:31.768+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:32.502 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:32.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:32.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:32.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:33.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:33.480+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:33.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:33.800+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:34.456 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:34.452+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:34.765 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:34.764+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:35.487 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:35.484+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:35.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:35.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:36.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:36.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:36.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:36.756+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:37.491 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:37.488+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:37.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:37.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:38.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:38.468+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:38.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:38.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:39.508 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:39.504+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:39.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:39.800+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:40.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:40.544+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:40.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:40.756+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:41.536 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:41.532+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:41.775 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:41.772+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:42.491 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:42.488+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:42.813 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:42.808+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:43.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:43.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:43.788 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:43.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:44.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:44.432+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:44.836 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:44.832+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:45.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:45.432+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:45.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:45.800+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:46.485 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:46.480+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:46.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:46.804+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:47.457 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:47.456+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:47.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:47.832+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:48.433 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:48.428+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:48.827 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:48.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:49.407 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:49.404+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:49.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:49.788+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:50.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:50.356+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:50.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:50.768+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:51.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:51.320+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:51.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:51.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:52.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:52.304+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:52.827 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:52.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:53.354 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:53.352+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:53.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:53.868+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:54.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:54.328+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:54.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:54.848+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:55.316 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:55.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:55.812 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:55.808+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:56.341 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:56.336+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:56.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:56.772+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:57.362 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:57.360+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:57.765 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:57.764+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:58.324 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:58.320+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:58.725 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:58.724+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:38:59.365 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:38:59.360+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:38:59.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:38:59.728+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:00.401 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:00.400+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:00.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:00.740+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:01.451 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:01.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:01.729 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:01.728+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:02.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:02.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:02.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:02.732+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:03.505 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:03.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:03.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:03.732+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:04.534 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:04.532+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:04.767 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:04.764+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:05.571 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:05.568+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:05.758 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:05.756+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:06.608 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:06.604+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:06.768 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:06.764+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:07.583 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:07.580+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:07.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:07.812+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:08.620 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:08.616+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:08.828 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:08.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:09.578 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:09.576+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:09.846 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:09.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:10.538 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:10.536+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:10.806 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:10.804+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:11.534 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:11.532+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:11.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:11.800+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:12.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:12.516+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:12.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:12.756+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:13.477 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:13.472+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:13.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:13.740+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:14.512 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:14.508+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:14.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:14.764+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:15.556 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:15.552+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:15.762 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:15.760+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:16.583 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:16.580+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:16.727 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:16.724+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:17.570 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:17.568+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:17.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:17.736+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:18.605 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:18.604+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:18.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:18.756+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:19.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:19.599+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:19.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:19.767+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:20.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:20.571+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:20.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:20.767+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:21.536 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:21.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:21.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:21.799+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:22.551 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:22.547+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:22.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:22.831+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:23.580 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:23.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:23.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:23.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:24.567 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:24.563+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:24.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:24.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:25.594 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:25.591+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:25.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:25.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:26.628 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:26.623+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:26.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:26.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:27.578 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:27.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:27.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:27.791+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:28.606 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:28.603+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:28.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:28.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:29.625 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:29.623+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:29.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:29.787+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:30.660 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:30.655+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:30.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:30.831+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:31.674 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:31.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:31.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:31.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:32.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:32.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:32.865 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:32.859+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:33.649 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:33.643+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:33.897 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:33.891+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:34.641 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:34.639+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:34.891 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:34.887+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:35.664 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:35.659+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:35.902 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:35.899+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:36.671 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:36.667+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:36.943 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:36.939+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:37.714 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:37.711+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:37.924 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:37.919+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:38.673 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:38.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:38.903 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:38.899+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:39.686 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:39.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:39.942 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:39.939+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:40.657 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:40.655+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:40.937 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:40.931+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:41.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:41.611+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:41.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:41.907+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:42.597 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:42.595+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:42.875 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:42.871+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:43.551 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:43.547+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:43.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:43.863+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:44.511 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:44.507+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:44.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:44.831+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:45.560 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:45.555+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:45.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:45.867+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:46.594 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:46.591+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:46.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:46.915+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:47.549 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:47.547+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:47.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:47.895+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:48.593 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:48.591+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:48.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:48.879+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:49.563 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:49.559+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:49.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:49.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:50.553 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:50.547+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:50.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:50.839+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:51.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:51.563+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:51.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:51.867+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:52.562 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:52.559+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:52.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:52.903+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:53.567 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:53.563+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:53.889 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:53.887+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:54.541 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:54.539+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:54.903 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:54.899+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:55.494 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:55.491+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:55.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:55.895+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:56.541 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:56.539+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:56.860 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:56.855+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:57.549 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:57.547+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:57.869 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:57.867+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:58.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:58.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:58.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:58.867+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:39:59.588 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:39:59.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:39:59.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:39:59.867+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:00.633 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:00.631+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:00.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:00.915+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:01.653 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:01.651+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:01.913 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:01.907+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:02.619 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:02.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:02.923 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:02.919+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:03.638 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:03.635+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:03.940 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:03.935+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:04.643 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:04.639+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:04.933 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:04.931+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:05.622 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:05.619+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:05.951 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:05.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:06.577 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:06.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:06.915 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:06.911+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:07.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:07.559+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:07.867 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:07.863+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:08.573 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:08.571+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:08.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:08.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:09.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:09.611+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:09.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:09.775+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:10.650 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:10.647+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:10.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:10.775+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:11.686 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:11.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:11.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:11.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:12.682 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:12.679+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:12.846 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:12.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:13.733 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:13.727+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:13.875 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:13.871+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:14.723 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:14.719+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:14.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:14.851+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:15.750 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:15.747+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:15.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:15.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:16.750 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:16.747+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:16.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:16.807+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:17.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:17.791+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:17.801 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:17.799+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:18.799 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:18.795+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:18.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:18.811+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:19.759 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:19.755+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:19.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:19.799+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:20.713 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:20.707+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:20.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:20.755+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:21.709 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:21.707+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:21.749 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:21.747+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:22.699 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:22.695+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:22.765 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:22.759+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:23.668 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:23.663+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:23.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:23.715+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:24.666 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:24.663+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:24.680 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:24.675+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:25.677 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:25.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:25.727 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:25.723+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:26.632 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:26.627+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:26.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:26.711+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:27.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:27.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:27.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:27.707+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:28.598 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:28.595+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:28.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:28.747+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:29.618 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:29.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:29.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:29.699+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:30.623 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:30.619+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:30.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:30.743+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:31.629 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:31.627+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:31.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:31.767+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:32.666 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:32.663+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:32.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:32.763+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:33.691 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:33.687+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:33.764 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:33.759+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:34.703 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:34.699+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:34.721 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:34.715+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:35.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:35.671+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:35.679 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:35.675+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:36.671 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:36.667+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:36.728 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:36.723+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:37.660 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:37.655+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:37.689 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:37.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:38.656 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:38.651+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:38.662 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:38.659+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:39.642 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:39.639+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:39.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:39.703+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:40.617 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:40.611+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:40.692 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:40.687+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:41.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:41.643+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:41.683 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:41.679+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:42.643 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:42.639+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:42.654 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:42.651+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:43.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:43.623+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:43.650 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:43.647+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:44.650 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:44.647+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:44.681 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:44.675+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:45.613 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:45.611+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:45.706 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:45.703+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:46.609 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:46.603+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:46.693 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:46.691+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:47.655 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:47.651+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:47.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:47.663+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:48.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:48.623+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:48.639 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:48.635+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:49.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:49.643+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:49.667 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:49.663+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:50.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:50.623+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:50.643 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:50.639+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:51.601 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:51.595+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:51.620 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:51.615+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:52.633 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:52.631+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:52.651 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:52.647+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:53.658 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:53.655+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:53.686 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:53.683+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:54.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:54.671+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:54.685 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:54.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:55.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:55.627+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:55.685 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:55.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:56.681 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:56.679+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:56.688 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:56.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:57.649 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:57.646+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:57.671 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:57.666+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:58.633 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:58.626+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:58.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:58.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:40:59.606 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:40:59.602+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:40:59.690 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:40:59.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:00.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:00.562+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:00.732 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:00.726+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:01.531 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:01.526+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:01.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:01.722+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:02.535 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:02.530+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:02.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:02.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:03.534 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:03.530+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:03.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:03.662+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:04.510 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:04.506+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:04.708 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:04.702+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:05.516 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:05.510+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:05.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:05.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:06.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:06.466+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:06.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:06.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:07.509 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:07.506+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:07.724 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:07.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:08.463 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:08.458+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:08.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:08.702+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:09.475 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:09.470+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:09.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:09.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:10.466 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:10.462+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:10.748 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:10.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:11.506 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:11.502+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:11.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:11.758+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:12.487 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:12.482+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:12.733 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:12.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:13.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:13.522+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:13.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:13.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:14.529 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:14.526+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:14.720 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:14.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:15.546 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:15.542+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:15.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:15.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:16.560 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:16.554+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:16.736 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:16.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:17.571 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:17.566+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:17.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:17.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:18.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:18.590+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:18.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:18.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:19.621 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:19.618+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:19.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:19.782+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:20.633 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:20.630+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:20.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:20.790+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:21.590 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:21.586+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:21.836 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:21.830+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:22.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:22.622+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:22.833 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:22.826+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:23.668 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:23.662+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:23.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:23.798+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:24.684 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:24.678+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:24.839 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:24.834+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:25.708 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:25.702+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:25.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:25.818+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:26.681 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:26.678+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:26.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:26.826+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:27.642 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:27.638+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:27.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:27.862+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:28.662 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:28.658+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:28.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:28.830+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:29.628 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:29.622+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:29.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:29.806+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:30.674 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:30.670+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:30.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:30.818+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:31.720 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:31.714+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:31.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:31.838+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:32.697 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:32.694+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:32.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:32.818+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:33.709 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:33.702+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:33.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:33.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:34.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:34.682+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:34.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:34.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:35.648 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:35.642+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:35.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:35.734+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:36.683 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:36.678+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:36.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:36.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:37.721 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:37.718+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:37.733 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:37.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:38.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:38.726+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:38.768 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:38.762+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:39.752 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:39.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:39.755 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:39.750+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:40.727 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:40.722+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:40.762 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:40.758+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:41.684 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:41.678+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:41.742 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:41.738+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:42.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:42.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:42.724 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:42.718+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:43.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:43.738+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:43.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:43.746+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:44.710 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:44.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:44.747 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:44.742+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:45.721 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:45.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:45.776 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:45.770+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:46.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:46.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:46.818 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:46.814+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:47.720 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:47.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:47.832 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:47.826+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:48.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:48.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:48.866 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:48.862+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:49.746 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:49.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:49.902 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:49.898+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:50.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:50.790+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:50.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:50.942+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:51.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:51.782+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:51.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:51.962+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:52.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:52.794+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:52.941 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:52.938+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:53.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:53.794+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:53.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:53.954+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:54.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:54.826+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:54.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:54.962+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:55.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:55.830+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:55.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:55.970+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:56.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:56.878+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:56.969 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:56.966+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:57.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:57.854+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:57.922 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:57.918+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:58.879 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:58.874+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:58.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:58.950+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:41:59.853 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:41:59.850+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:41:59.985 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:41:59.978+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:00.814 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:00.810+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:01.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:01.002+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:01.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:01.830+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:02.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:02.022+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:02.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:02.806+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:02.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:02.994+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:03.836 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:03.830+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:04.003 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:03.998+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:04.885 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:04.882+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:04.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:04.994+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:05.913 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:05.906+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:06.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:06.010+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:06.948 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:06.942+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:06.995 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:06.990+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:07.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:07.950+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:07.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:07.986+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:09.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:08.994+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:09.034 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:09.030+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:10.041 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:10.038+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:10.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:10.038+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:11.007 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:11.002+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:11.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:11.018+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:11.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:11.966+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:12.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:12.030+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:12.983 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:12.978+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:13.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:13.010+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:13.986 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:13.982+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:14.050 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:14.046+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:14.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:14.966+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:15.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:15.038+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:15.948 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:15.942+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:16.004 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:15.998+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:16.983 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:16.978+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:17.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:17.014+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:17.996 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:17.990+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:18.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:18.014+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:18.995 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:18.990+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:19.020 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:19.014+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:19.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:19.994+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:20.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:20.030+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:21.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:21.010+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:21.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:21.066+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:21.995 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:21.990+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:22.078 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:22.074+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:23.019 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:23.014+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:23.055 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:23.050+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:24.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:24.002+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:24.041 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:24.038+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:24.989 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:24.986+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:25.036 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:25.030+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:25.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:25.962+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:26.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:25.994+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:27.012 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:27.006+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:27.041 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:27.034+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:28.038 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:28.034+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:28.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:28.034+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:29.003 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:28.998+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:29.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:29.062+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:29.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:29.986+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:30.031 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:30.026+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:30.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:30.986+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:31.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:31.006+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:31.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:31.978+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:32.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:32.018+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:32.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:32.982+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:33.030 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:33.026+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:34.003 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:33.998+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:34.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:34.054+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:35.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:35.006+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:35.020 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:35.014+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:35.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:35.986+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:36.053 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:36.046+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:37.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:37.006+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:37.039 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:37.034+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:38.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:38.009+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:38.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:38.021+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:39.032 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:39.025+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:39.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:39.049+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:40.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:40.057+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:40.085 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:40.077+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:41.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:41.021+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:41.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:41.037+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:42.010 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:42.005+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:42.078 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:42.073+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:42.985 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:42.977+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:43.037 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:43.029+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:43.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:43.977+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:44.066 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:44.061+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:44.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:44.965+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:45.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:45.077+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:45.936 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:45.929+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:46.105 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:46.097+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:46.922 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:46.917+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:47.094 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:47.089+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:47.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:47.917+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:48.115 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:48.113+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:48.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:48.929+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:49.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:49.077+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:49.881 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:49.877+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:50.123 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:50.121+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:50.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:50.925+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:51.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:51.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:51.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:51.953+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:52.176 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:52.173+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:53.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:53.005+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:53.191 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:53.189+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:53.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:53.965+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:54.241 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:54.237+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:54.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:54.985+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:55.286 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:55.285+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:55.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:55.945+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:56.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:56.321+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:56.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:56.925+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:57.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:57.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:57.948 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:57.945+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:58.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:58.309+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:58.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:58.953+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:42:59.301 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:42:59.297+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:42:59.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:42:59.961+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:00.327 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:00.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:01.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:00.997+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:01.279 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:01.277+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:01.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:01.965+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:02.299 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:02.297+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:02.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:02.953+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:03.328 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:03.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:03.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:03.973+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:04.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:04.309+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:05.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:05.021+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:05.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:05.349+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:06.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:06.017+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:06.339 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:06.337+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:07.008 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:07.005+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:07.330 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:07.329+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:07.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:07.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:08.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:08.317+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:09.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:08.997+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:09.275 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:09.273+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:10.027 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:10.025+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:10.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:10.273+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:10.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:10.981+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:11.272 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:11.269+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:11.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:11.993+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:12.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:12.313+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:13.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:13.001+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:13.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:13.301+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:14.049 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:14.049+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:14.277 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:14.277+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:15.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:15.089+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:15.300 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:15.297+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:16.064 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:16.061+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:16.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:16.321+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:17.059 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:17.057+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:17.368 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:17.365+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:18.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:18.073+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:18.415 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:18.413+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:19.090 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:19.089+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:19.424 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:19.421+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:20.078 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:20.077+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:20.389 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:20.389+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:21.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:21.061+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:21.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:21.349+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:22.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:22.069+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:22.389 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:22.389+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:23.038 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:23.037+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:23.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:23.369+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:24.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:24.065+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:24.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:24.369+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:25.034 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:25.033+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:25.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:25.369+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:25.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:25.997+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:26.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:26.421+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:26.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:26.985+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:27.446 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:27.445+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:28.026 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:28.017+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:28.412 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:28.409+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:29.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:29.041+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:29.408 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:29.405+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:30.027 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:30.025+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:30.406 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:30.405+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:31.042 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:31.041+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:31.451 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:31.449+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:32.062 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:32.061+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:32.412 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:32.409+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:33.103 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:33.101+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:33.430 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:33.429+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:34.113 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:34.113+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:34.381 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:34.381+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:35.101 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:35.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:35.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:35.401+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:36.086 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:36.085+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:36.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:36.441+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:37.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:37.113+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:37.473 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:37.469+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:38.135 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:38.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:38.509 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:38.505+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:39.124 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:39.121+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:39.514 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:39.513+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:40.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:40.109+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:40.533 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:40.529+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:41.150 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:41.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:41.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:41.545+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:42.140 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:42.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:42.524 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:42.521+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:43.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:43.109+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:43.554 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:43.553+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:44.070 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:44.069+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:44.554 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:44.553+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:45.117 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:45.113+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:45.555 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:45.553+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:46.149 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:46.145+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:46.516 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:46.513+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:47.163 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:47.161+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:47.547 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:47.545+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:48.194 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:48.193+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:48.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:48.573+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:49.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:49.209+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:49.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:49.613+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:50.239 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:50.237+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:50.659 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:50.657+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:51.239 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:51.237+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:51.699 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:51.697+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:52.201 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:52.197+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:52.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:52.685+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:53.226 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:53.225+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:53.706 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:53.705+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:54.217 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:54.217+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:54.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:54.741+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:55.251 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:55.249+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:55.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:55.705+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:56.299 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:56.297+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:56.692 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:56.689+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:57.350 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:57.349+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:57.698 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:57.697+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:58.344 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:58.341+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:58.664 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:58.661+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:43:59.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:43:59.309+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:43:59.714 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:43:59.713+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:00.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:00.325+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:00.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:00.741+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:01.371 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:01.369+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:01.759 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:01.757+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:02.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:02.409+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:02.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:02.745+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:03.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:03.385+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:03.740 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:03.737+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:04.435 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:04.433+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:04.720 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:04.717+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:05.392 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:05.389+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:05.751 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:05.749+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:06.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:06.437+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:06.720 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:06.717+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:07.452 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:07.449+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:07.732 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:07.729+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:08.496 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:08.493+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:08.722 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:08.721+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:09.512 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:09.509+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:09.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:09.685+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:10.507 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:10.505+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:10.673 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:10.673+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:11.541 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:11.537+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:11.638 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:11.637+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:12.524 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:12.520+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:12.650 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:12.644+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:13.488 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:13.484+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:13.683 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:13.680+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:14.460 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:14.456+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:14.645 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:14.640+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:15.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:15.464+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:15.607 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:15.604+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:16.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:16.496+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:16.628 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:16.624+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:17.543 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:17.540+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:17.637 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:17.632+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:18.590 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:18.588+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:18.677 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:18.672+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:19.640 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:19.636+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:19.662 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:19.660+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:20.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:20.600+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:20.639 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:20.636+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:21.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:21.588+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:21.622 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:21.620+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:22.579 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:22.576+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:22.634 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:22.632+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:23.605 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:23.600+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:23.614 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:23.612+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:24.580 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:24.576+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:24.664 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:24.660+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:25.617 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:25.612+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:25.636 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:25.632+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:26.612 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:26.608+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:26.636 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:26.632+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:27.571 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:27.568+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:27.653 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:27.652+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:28.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:28.588+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:28.640 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:28.636+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:29.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:29.544+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:29.682 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:29.680+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:30.514 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:30.512+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:30.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:30.712+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:31.481 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:31.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:31.688 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:31.684+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:32.502 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:32.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:32.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:32.700+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:33.516 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:33.512+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:33.754 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:33.752+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:34.561 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:34.556+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:34.725 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:34.720+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:35.528 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:35.524+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:35.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:35.696+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:36.502 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:36.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:36.680 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:36.676+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:37.510 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:37.508+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:37.722 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:37.720+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:38.561 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:38.556+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:38.712 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:38.708+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:39.580 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:39.576+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:39.744 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:39.740+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:40.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:40.564+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:40.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:40.720+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:41.561 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:41.556+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:41.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:41.764+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:42.520 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:42.516+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:42.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:42.736+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:43.542 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:43.540+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:43.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:43.720+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:44.522 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:44.520+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:44.699 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:44.696+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:45.485 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:45.480+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:45.749 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:45.744+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:46.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:46.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:46.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:46.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:47.411 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:47.408+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:47.771 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:47.768+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:48.422 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:48.420+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:48.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:48.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:49.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:49.456+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:49.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:49.732+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:50.415 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:50.412+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:50.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:50.732+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:51.451 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:51.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:51.691 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:51.688+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:52.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:52.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:52.678 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:52.676+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:53.407 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:53.404+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:53.692 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:53.688+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:54.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:54.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:54.743 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:54.740+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:55.355 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:55.352+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:55.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:55.752+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:56.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:56.360+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:56.733 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:56.728+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:57.332 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:57.328+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:57.699 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:57.696+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:58.286 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:58.284+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:58.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:58.748+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:44:59.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:44:59.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:44:59.787 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:44:59.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:00.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:00.260+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:00.806 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:00.804+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:01.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:01.240+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:01.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:01.828+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:02.288 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:02.284+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:02.818 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:02.816+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:03.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:03.328+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:03.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:03.788+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:04.305 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:04.300+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:04.818 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:04.816+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:05.267 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:05.264+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:05.850 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:05.848+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:06.221 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:06.216+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:06.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:06.804+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:07.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:07.252+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:07.787 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:07.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:08.224 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:08.220+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:08.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:08.788+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:09.199 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:09.196+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:09.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:09.832+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:10.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:10.168+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:10.850 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:10.848+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:11.197 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:11.192+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:11.867 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:11.864+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:12.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:12.156+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:12.909 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:12.904+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:13.114 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:13.112+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:13.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:13.916+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:14.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:14.068+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:14.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:14.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:15.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:15.052+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:15.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:15.928+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:16.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:16.032+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:16.936 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:16.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:17.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:17.032+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:17.971 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:17.968+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:18.076 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:18.072+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:18.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:18.944+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:19.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:19.112+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:19.951 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:19.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:20.122 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:20.120+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:20.949 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:20.944+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:21.082 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:21.080+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:21.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:21.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:22.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:22.068+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:22.986 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:22.984+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:23.069 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:23.064+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:23.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:23.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:24.031 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:24.028+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:24.988 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:24.984+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:25.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:25.040+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:25.993 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:25.988+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:26.082 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:26.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:26.974 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:26.972+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:27.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:27.108+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:27.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:27.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:28.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:28.084+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:28.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:28.892+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:29.092 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:29.088+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:29.923 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:29.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:30.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:30.068+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:30.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:30.892+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:31.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:31.024+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:31.891 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:31.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:32.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:32.040+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:32.868 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:32.864+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:33.009 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:33.004+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:33.845 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:33.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:33.978 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:33.976+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:34.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:34.800+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:34.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:34.976+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:35.763 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:35.760+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:35.938 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:35.936+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:36.743 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:36.740+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:36.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:36.972+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:37.699 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:37.696+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:37.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:37.984+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:38.674 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:38.672+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:38.995 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:38.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:39.665 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:39.664+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:40.023 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:40.020+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:40.628 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:40.624+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:41.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:40.996+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:41.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:41.592+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:41.981 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:41.976+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:42.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:42.588+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:42.951 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:42.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:43.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:43.612+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:43.952 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:43.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:44.650 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:44.648+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:44.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:44.912+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:45.693 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:45.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:45.902 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:45.900+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:46.654 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:46.652+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:46.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:46.852+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:47.699 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:47.695+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:47.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:47.875+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:48.657 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:48.651+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:48.901 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:48.895+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:49.680 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:49.675+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:49.860 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:49.855+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:50.633 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:50.627+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:50.897 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:50.891+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:51.680 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:51.675+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:51.904 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:51.899+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:52.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:52.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:52.952 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:52.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:53.724 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:53.719+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:53.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:53.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:54.770 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:54.767+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:54.978 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:54.975+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:55.777 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:55.771+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:55.952 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:55.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:56.767 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:56.763+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:56.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:56.987+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:57.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:57.811+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:57.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:57.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:58.839 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:58.835+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:58.958 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:58.955+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:45:59.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:45:59.847+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:45:59.949 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:45:59.943+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:00.839 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:00.835+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:00.969 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:00.963+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:01.886 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:01.883+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:01.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:01.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:02.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:02.911+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:02.936 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:02.931+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:03.888 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:03.883+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:03.904 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:03.899+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:04.939 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:04.935+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:04.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:04.935+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:05.910 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:05.907+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:05.925 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:05.919+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:06.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:06.895+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:06.903 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:06.899+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:07.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:07.911+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:07.929 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:07.923+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:08.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:08.911+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:08.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:08.963+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:09.907 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:09.903+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:09.956 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:09.951+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:10.923 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:10.919+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:10.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:10.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:11.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:11.959+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:11.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:11.979+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:12.937 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:12.931+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:12.944 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:12.939+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:13.909 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:13.903+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:13.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:13.923+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:14.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:14.887+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:14.912 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:14.907+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:15.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:15.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:15.918 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:15.915+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:16.860 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:16.855+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:16.878 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:16.875+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:17.879 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:17.875+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:17.896 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:17.891+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:18.888 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:18.883+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:18.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:18.927+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:19.886 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:19.883+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:19.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:19.919+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:20.906 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:20.903+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:20.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:20.943+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:21.894 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:21.891+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:21.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:21.975+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:22.921 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:22.915+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:23.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:23.007+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:23.902 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:23.899+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:24.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:24.015+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:24.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:24.903+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:25.013 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:25.007+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:25.947 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:25.943+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:26.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:26.027+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:26.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:26.971+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:26.987 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:26.983+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:28.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:27.999+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:28.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:28.003+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:28.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:28.975+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:29.008 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:29.003+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:29.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:29.971+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:30.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:29.995+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:31.003 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:30.999+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:31.011 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:31.007+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:32.033 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:32.027+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:32.052 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:32.047+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:33.051 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:33.047+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:33.100 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:33.095+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:34.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:34.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:34.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:34.139+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:35.072 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:35.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:35.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:35.187+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:36.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:36.039+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:36.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:36.195+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:37.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:37.071+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:37.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:37.227+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:38.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:38.039+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:38.223 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:38.219+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:39.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:38.999+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:39.251 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:39.247+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:40.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:40.007+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:40.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:40.231+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:41.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:41.015+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:41.232 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:41.227+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:42.055 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:42.051+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:42.251 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:42.247+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:43.062 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:43.059+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:43.204 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:43.199+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:44.056 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:44.051+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:44.176 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:44.171+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:45.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:45.007+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:45.161 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:45.155+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:46.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:46.051+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:46.136 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:46.131+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:47.027 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:47.023+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:47.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:47.155+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:48.035 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:48.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:48.143 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:48.139+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:49.011 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:49.007+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:49.185 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:49.179+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:49.973 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:49.967+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:50.201 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:50.195+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:50.983 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:50.979+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:51.185 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:51.179+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:52.034 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:52.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:52.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:52.195+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:53.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:53.015+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:53.153 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:53.147+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:54.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:54.007+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:54.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:54.187+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:55.042 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:55.039+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:55.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:55.227+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:56.088 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:56.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:56.266 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:56.263+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:57.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:57.055+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:57.260 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:57.255+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:58.054 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:58.051+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:58.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:58.291+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:59.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:59.007+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:46:59.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:46:59.247+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:46:59.981 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:46:59.975+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:00.221 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:00.215+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:01.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:01.015+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:01.260 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:01.255+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:02.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:02.027+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:02.257 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:02.251+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:03.060 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:03.055+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:03.265 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:03.259+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:04.100 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:04.095+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:04.272 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:04.267+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:05.146 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:05.143+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:05.274 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:05.271+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:06.125 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:06.119+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:06.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:06.231+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:07.161 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:07.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:07.219 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:07.215+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:08.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:08.199+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:08.206 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:08.203+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:09.190 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:09.183+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:09.250 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:09.247+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:10.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:10.195+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:10.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:10.235+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:11.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:11.191+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:11.263 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:11.259+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:12.211 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:12.207+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:12.290 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:12.287+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:13.208 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:13.203+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:13.327 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:13.323+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:14.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:14.215+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:14.341 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:14.335+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:15.191 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:15.187+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:15.348 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:15.343+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:16.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:16.231+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:16.398 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:16.395+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:17.244 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:17.239+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:17.388 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:17.383+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:18.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:18.231+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:18.436 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:18.431+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:19.244 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:19.239+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:19.470 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:19.463+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:20.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:20.207+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:20.455 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:20.451+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:21.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:21.207+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:21.462 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:21.455+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:22.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:22.227+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:22.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:22.435+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:23.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:23.215+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:23.488 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:23.483+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:24.224 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:24.218+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:24.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:24.530+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:25.245 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:25.238+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:25.515 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:25.510+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:26.222 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:26.218+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:26.565 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:26.558+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:27.231 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:27.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:27.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:27.598+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:28.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:28.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:28.630 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:28.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:29.242 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:29.238+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:29.631 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:29.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:30.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:30.254+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:30.623 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:30.618+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:31.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:31.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:31.592 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:31.586+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:32.246 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:32.242+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:32.636 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:32.630+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:33.280 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:33.274+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:33.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:33.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:34.312 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:34.306+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:34.702 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:34.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:35.275 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:35.270+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:35.725 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:35.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:36.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:36.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:36.748 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:36.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:37.204 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:37.198+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:37.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:37.710+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:38.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:38.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:38.727 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:38.722+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:39.218 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:39.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:39.686 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:39.682+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:40.219 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:40.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:40.729 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:40.722+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:41.190 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:41.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:41.690 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:41.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:42.208 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:42.202+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:42.694 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:42.690+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:43.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:43.182+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:43.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:43.734+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:44.152 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:44.146+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:44.744 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:44.738+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:45.187 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:45.182+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:45.742 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:45.738+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:46.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:46.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:46.772 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:46.766+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:47.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:47.190+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:47.768 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:47.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:48.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:48.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:48.727 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:48.722+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:49.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:49.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:49.743 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:49.738+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:50.250 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:50.246+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:50.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:50.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:51.221 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:51.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:51.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:51.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:52.185 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:52.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:52.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:52.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:53.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:53.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:53.743 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:53.738+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:54.159 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:54.154+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:54.695 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:54.690+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:55.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:55.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:55.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:55.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:56.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:56.106+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:56.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:56.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:57.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:57.158+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:57.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:57.774+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:58.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:58.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:58.739 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:58.734+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:47:59.157 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:47:59.150+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:47:59.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:47:59.758+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:00.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:00.138+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:00.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:00.806+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:01.147 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:01.142+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:01.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:01.854+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:02.176 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:02.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:02.911 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:02.906+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:03.193 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:03.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:03.942 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:03.938+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:04.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:04.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:04.958 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:04.954+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:05.231 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:05.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:05.933 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:05.926+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:06.258 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:06.254+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:06.946 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:06.942+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:07.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:07.274+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:07.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:07.966+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:08.294 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:08.290+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:08.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:08.958+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:09.308 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:09.302+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:09.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:09.926+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:10.310 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:10.302+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:10.938 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:10.934+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:11.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:11.350+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:11.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:11.958+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:12.352 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:12.346+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:12.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:12.962+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:13.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:13.378+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:13.992 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:13.986+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:14.408 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:14.402+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:14.952 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:14.946+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:15.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:15.386+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:15.965 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:15.958+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:16.381 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:16.374+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:17.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:17.002+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:17.408 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:17.402+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:17.983 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:17.978+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:18.431 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:18.426+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:19.026 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:19.022+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:19.396 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:19.390+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:19.981 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:19.974+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:20.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:20.386+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:20.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:20.986+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:21.404 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:21.398+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:22.023 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:22.018+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:22.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:22.378+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:23.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:23.014+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:23.416 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:23.410+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:24.060 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:24.054+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:24.419 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:24.414+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:25.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:25.050+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:25.370 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:25.366+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:26.049 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:26.042+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:26.381 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:26.374+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:27.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:27.002+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:27.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:27.350+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:27.988 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:27.982+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:28.317 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:28.310+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:29.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:28.998+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:29.279 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:29.274+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:30.008 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:30.002+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:30.324 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:30.318+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:30.971 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:30.966+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:31.337 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:31.330+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:31.941 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:31.934+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:32.290 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:32.286+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:32.925 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:32.918+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:33.340 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:33.334+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:33.905 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:33.898+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:34.368 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:34.362+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:34.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:34.902+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:35.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:35.390+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:35.897 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:35.890+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:36.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:36.374+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:36.853 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:36.846+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:37.409 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:37.402+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:37.857 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:37.850+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:38.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:38.370+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:38.903 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:38.898+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:39.418 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:39.414+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:39.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:39.902+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:40.394 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:40.390+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:40.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:40.866+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:41.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:41.410+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:41.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:41.874+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:42.425 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:42.418+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:42.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:42.866+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:43.433 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:43.426+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:43.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:43.842+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:44.448 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:44.442+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:44.866 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:44.862+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:45.440 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:45.434+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:45.850 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:45.846+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:46.395 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:46.390+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:46.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:46.818+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:47.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:47.406+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:47.806 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:47.798+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:48.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:48.378+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:48.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:48.782+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:49.363 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:49.358+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:49.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:49.734+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:50.345 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:50.338+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:50.739 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:50.734+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:51.325 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:51.318+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:51.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:51.734+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:52.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:52.310+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:52.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:52.726+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:53.290 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:53.286+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:53.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:53.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:54.305 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:54.298+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:54.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:54.778+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:55.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:55.258+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:55.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:55.798+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:56.219 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:56.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:56.846 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:56.842+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:57.180 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:57.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:57.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:57.826+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:58.151 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:58.146+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:58.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:58.818+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:48:59.111 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:48:59.106+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:48:59.833 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:48:59.826+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:00.087 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:00.082+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:00.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:00.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:01.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:01.110+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:01.753 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:01.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:02.167 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:02.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:02.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:02.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:03.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:03.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:03.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:03.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:04.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:04.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:04.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:04.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:05.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:05.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:05.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:05.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:06.206 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:06.202+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:06.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:06.774+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:07.208 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:07.201+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:07.767 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:07.761+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:08.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:08.205+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:08.762 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:08.757+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:09.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:09.185+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:09.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:09.729+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:10.147 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:10.141+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:10.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:10.709+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:11.138 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:11.129+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:11.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:11.665+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:12.166 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:12.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:12.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:12.641+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:13.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:13.173+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:13.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:13.621+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:14.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:14.173+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:14.635 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:14.629+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:15.206 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:15.201+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:15.684 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:15.677+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:16.202 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:16.193+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:16.637 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:16.633+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:17.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:17.185+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:17.658 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:17.653+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:18.193 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:18.189+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:18.684 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:18.681+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:19.222 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:19.217+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:19.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:19.677+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:20.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:20.249+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:20.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:20.697+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:21.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:21.281+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:21.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:21.733+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:22.314 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:22.313+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:22.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:22.781+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:23.298 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:23.297+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:23.765 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:23.761+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:24.297 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:24.293+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:24.762 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:24.757+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:25.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:25.329+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:25.753 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:25.749+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:26.329 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:26.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:26.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:26.773+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:27.363 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:27.361+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:27.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:27.797+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:28.328 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:28.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:28.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:28.849+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:29.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:29.373+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:29.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:29.833+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:30.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:30.413+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:30.866 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:30.865+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:31.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:31.433+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:31.902 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:31.901+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:32.485 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:32.481+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:32.940 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:32.937+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:33.471 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:33.469+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:33.963 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:33.961+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:34.434 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:34.433+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:34.936 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:34.933+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:35.405 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:35.401+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:35.940 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:35.937+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:36.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:36.401+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:36.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:36.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:37.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:37.437+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:37.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:37.985+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:38.485 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:38.481+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:38.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:38.965+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:39.485 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:39.481+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:39.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:39.973+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:40.447 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:40.445+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:40.986 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:40.981+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:41.491 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:41.489+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:41.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:41.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:42.523 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:42.521+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:43.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:43.021+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:43.487 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:43.485+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:43.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:43.977+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:44.493 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:44.489+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:44.995 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:44.993+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:45.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:45.481+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:45.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:45.961+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:46.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:46.457+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:46.995 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:46.993+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:47.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:47.409+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:48.017 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:48.013+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:48.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:48.381+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:49.046 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:49.037+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:49.365 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:49.361+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:50.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:50.017+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:50.318 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:50.313+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:50.976 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:50.973+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:51.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:51.345+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:51.956 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:51.953+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:52.378 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:52.377+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:52.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:52.909+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:53.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:53.353+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:53.875 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:53.873+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:54.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:54.373+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:54.912 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:54.909+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:55.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:55.349+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:55.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:55.913+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:56.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:56.301+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:56.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:56.913+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:57.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:57.293+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:57.895 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:57.893+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:58.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:58.289+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:58.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:58.849+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:49:59.316 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:49:59.313+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:49:59.873 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:49:59.869+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:00.366 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:00.361+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:00.886 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:00.885+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:01.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:01.349+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:01.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:01.845+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:02.328 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:02.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:02.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:02.881+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:03.336 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:03.333+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:03.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:03.889+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:04.328 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:04.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:04.902 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:04.901+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:05.337 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:05.333+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:05.886 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:05.885+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:06.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:06.349+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:06.854 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:06.849+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:07.344 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:07.341+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:07.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:07.865+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:08.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:08.381+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:08.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:08.845+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:09.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:09.373+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:09.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:09.853+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:10.414 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:10.413+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:10.863 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:10.861+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:11.424 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:11.421+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:11.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:11.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:12.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:12.437+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:12.805 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:12.801+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:13.453 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:13.449+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:13.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:13.849+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:14.429 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:14.425+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:14.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:14.841+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:15.399 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:15.397+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:15.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:15.845+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:16.376 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:16.373+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:16.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:16.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:17.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:17.421+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:17.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:17.825+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:18.463 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:18.461+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:18.836 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:18.833+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:19.446 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:19.445+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:19.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:19.805+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:20.452 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:20.449+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:20.820 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:20.817+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:21.463 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:21.461+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:21.780 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:21.777+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:22.496 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:22.493+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:22.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:22.785+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:23.484 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:23.481+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:23.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:23.749+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:24.478 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:24.477+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:24.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:24.801+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:25.523 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:25.521+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:25.770 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:25.769+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:26.550 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:26.545+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:26.767 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:26.765+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:27.529 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:27.525+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:27.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:27.789+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:28.554 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:28.553+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:28.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:28.793+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:29.598 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:29.597+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:29.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:29.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:30.555 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:30.553+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:30.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:30.785+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:31.517 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:31.513+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:31.802 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:31.801+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:32.509 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:32.505+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:32.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:32.825+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:33.498 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:33.493+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:33.869 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:33.865+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:34.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:34.525+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:34.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:34.869+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:35.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:35.561+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:35.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:35.853+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:36.567 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:36.565+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:36.901 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:36.897+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:37.540 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:37.537+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:37.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:37.869+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:38.552 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:38.549+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:38.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:38.897+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:39.531 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:39.529+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:39.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:39.917+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:40.512 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:40.509+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:40.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:40.893+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:41.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:41.537+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:41.929 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:41.925+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:42.568 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:42.565+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:42.952 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:42.949+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:43.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:43.613+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:43.939 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:43.937+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:44.649 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:44.645+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:44.891 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:44.889+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:45.635 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:45.633+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:45.869 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:45.865+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:46.683 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:46.681+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:46.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:46.913+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:47.709 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:47.705+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:47.909 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:47.905+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:48.720 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:48.717+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:48.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:48.881+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:49.757 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:49.753+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:49.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:49.857+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:50.733 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:50.729+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:50.845 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:50.841+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:51.697 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:51.692+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:51.799 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:51.796+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:52.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:52.744+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:52.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:52.804+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:53.717 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:53.712+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:53.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:53.792+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:54.672 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:54.668+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:54.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:54.828+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:55.678 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:55.676+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:55.794 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:55.788+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:56.689 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:56.684+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:56.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:56.800+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:57.720 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:57.716+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:57.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:57.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:58.693 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:58.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:58.859 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:58.856+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:50:59.722 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:50:59.720+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:50:59.895 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:50:59.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:00.769 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:00.764+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:00.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:00.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:01.731 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:01.728+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:01.876 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:01.872+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:02.705 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:02.700+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:02.866 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:02.864+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:03.673 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:03.668+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:03.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:03.856+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:04.666 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:04.664+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:04.812 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:04.808+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:05.620 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:05.616+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:05.806 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:05.804+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:06.667 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:06.664+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:06.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:06.796+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:07.669 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:07.664+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:07.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:07.820+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:08.667 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:08.664+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:08.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:08.852+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:09.702 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:09.700+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:09.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:09.820+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:10.688 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:10.684+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:10.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:10.804+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:11.660 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:11.656+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:11.806 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:11.804+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:12.649 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:12.644+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:12.836 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:12.832+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:13.618 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:13.616+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:13.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:13.800+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:14.631 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:14.628+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:14.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:14.792+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:15.664 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:15.660+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:15.802 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:15.800+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:16.694 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:16.692+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:16.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:16.780+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:17.732 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:17.728+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:17.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:17.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:18.724 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:18.720+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:18.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:18.772+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:19.693 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:19.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:19.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:19.756+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:20.660 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:20.656+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:20.777 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:20.772+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:21.614 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:21.612+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:21.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:21.728+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:22.579 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:22.576+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:22.770 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:22.764+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:23.555 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:23.552+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:23.724 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:23.720+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:24.554 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:24.548+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:24.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:24.748+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:25.537 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:25.532+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:25.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:25.720+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:26.501 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:26.496+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:26.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:26.672+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:27.487 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:27.484+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:27.635 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:27.632+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:28.504 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:28.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:28.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:28.644+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:29.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:29.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:29.638 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:29.632+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:30.525 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:30.520+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:30.665 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:30.660+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:31.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:31.564+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:31.637 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:31.632+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:32.600 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:32.596+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:32.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:32.612+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:33.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:33.600+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:33.618 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:33.612+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:34.614 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:34.612+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:34.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:34.664+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:35.618 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:35.612+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:35.688 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:35.684+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:36.586 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:36.584+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:36.673 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:36.668+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:37.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:37.588+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:37.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:37.716+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:38.568 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:38.564+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:38.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:38.672+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:39.530 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:39.528+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:39.687 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:39.684+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:40.505 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:40.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:40.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:40.700+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:41.523 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:41.520+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:41.748 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:41.744+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:42.484 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:42.480+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:42.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:42.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:43.465 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:43.460+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:43.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:43.752+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:44.504 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:44.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:44.765 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:44.760+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:45.481 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:45.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:45.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:45.716+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:46.476 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:46.472+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:46.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:46.672+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:47.487 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:47.484+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:47.650 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:47.644+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:48.466 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:48.460+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:48.660 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:48.656+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:49.484 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:49.480+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:49.624 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:49.620+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:50.477 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:50.472+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:50.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:50.644+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:51.525 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:51.520+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:51.687 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:51.684+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:52.570 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:52.568+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:52.639 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:52.636+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:53.558 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:53.552+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:53.617 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:53.612+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:54.524 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:54.520+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:54.591 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:54.588+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:55.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:55.560+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:55.625 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:55.620+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:56.557 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:56.552+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:56.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:56.600+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:57.540 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:57.536+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:57.627 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:57.624+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:58.494 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:58.492+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:58.615 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:58.612+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:51:59.497 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:51:59.492+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:51:59.655 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:51:59.652+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:00.489 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:00.484+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:00.640 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:00.636+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:01.522 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:01.520+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:01.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:01.676+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:02.560 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:02.556+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:02.685 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:02.680+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:03.610 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:03.604+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:03.639 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:03.636+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:04.599 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:04.596+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:04.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:04.600+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:05.563 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:05.560+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:05.617 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:05.612+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:06.535 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:06.532+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:06.570 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:06.568+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:07.524 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:07.520+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:07.532 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:07.528+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:08.497 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:08.492+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:08.559 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:08.556+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:09.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:09.520+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:09.547 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:09.544+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:10.532 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:10.528+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:10.578 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:10.576+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:11.533 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:11.528+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:11.538 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:11.536+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:12.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:12.544+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:12.585 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:12.580+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:13.572 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:13.568+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:13.620 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:13.616+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:14.565 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:14.560+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:14.657 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:14.652+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:15.525 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:15.520+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:15.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:15.628+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:16.577 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:16.572+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:16.622 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:16.620+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:17.560 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:17.556+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:17.611 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:17.608+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:18.540 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:18.536+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:18.645 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:18.640+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:19.492 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:19.488+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:19.624 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:19.620+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:20.466 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:20.464+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:20.615 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:20.612+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:21.469 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:21.464+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:21.575 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:21.572+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:22.508 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:22.504+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:22.592 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:22.588+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:23.490 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:23.484+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:23.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:23.556+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:24.450 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:24.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:24.583 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:24.580+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:25.412 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:25.408+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:25.585 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:25.580+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:26.462 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:26.456+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:26.604 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:26.600+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:27.457 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:27.452+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:27.624 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:27.620+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:28.418 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:28.416+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:28.619 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:28.616+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:29.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:29.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:29.642 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:29.640+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:30.349 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:30.344+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:30.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:30.644+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:31.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:31.360+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:31.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:31.672+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:32.361 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:32.356+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:32.647 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:32.644+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:33.383 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:33.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:33.661 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:33.656+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:34.346 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:34.340+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:34.699 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:34.696+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:35.308 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:35.304+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:35.746 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:35.740+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:36.357 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:36.352+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:36.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:36.751+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:37.381 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:37.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:37.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:37.775+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:38.352 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:38.347+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:38.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:38.787+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:39.379 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:39.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:39.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:39.791+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:40.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:40.343+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:40.833 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:40.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:41.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:41.343+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:41.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:41.787+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:42.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:42.343+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:42.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:42.755+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:43.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:43.371+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:43.789 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:43.783+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:44.422 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:44.419+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:44.758 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:44.751+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:45.465 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:45.459+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:45.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:45.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:46.512 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:46.507+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:46.850 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:46.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:47.494 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:47.487+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:47.874 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:47.871+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:48.517 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:48.511+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:48.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:48.879+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:49.565 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:49.559+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:49.843 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:49.839+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:50.593 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:50.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:50.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:50.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:51.587 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:51.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:51.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:51.811+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:52.631 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:52.627+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:52.771 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:52.767+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:53.679 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:53.675+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:53.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:53.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:54.694 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:54.691+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:54.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:54.863+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:55.744 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:55.739+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:55.838 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:55.835+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:56.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:56.739+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:56.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:56.851+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:57.718 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:57.711+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:57.843 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:57.839+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:58.678 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:58.675+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:58.867 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:58.863+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:52:59.728 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:52:59.723+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:52:59.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:52:59.879+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:00.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:00.735+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:00.897 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:00.891+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:01.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:01.735+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:01.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:01.923+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:02.753 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:02.747+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:02.951 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:02.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:03.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:03.703+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:03.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:03.911+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:04.665 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:04.659+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:04.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:04.887+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:05.664 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:05.659+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:05.874 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:05.867+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:06.636 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:06.631+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:06.846 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:06.839+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:07.639 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:07.635+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:07.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:07.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:08.606 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:08.603+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:08.853 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:08.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:09.634 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:09.631+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:09.827 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:09.823+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:10.661 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:10.655+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:10.820 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:10.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:11.694 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:11.691+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:11.843 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:11.839+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:12.742 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:12.739+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:12.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:12.795+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:13.792 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:13.787+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:13.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:13.791+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:14.765 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:14.759+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:14.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:14.831+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:15.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:15.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:15.838 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:15.831+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:16.772 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:16.767+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:16.831 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:16.827+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:17.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:17.751+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:17.833 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:17.827+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:18.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:18.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:18.880 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:18.875+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:19.788 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:19.783+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:19.896 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:19.891+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:20.821 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:20.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:20.913 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:20.907+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:21.813 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:21.807+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:21.953 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:21.947+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:22.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:22.775+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:22.999 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:22.995+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:23.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:23.767+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:23.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:23.955+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:24.764 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:24.759+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:25.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:24.999+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:25.722 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:25.715+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:26.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:26.027+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:26.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:26.727+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:27.041 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:27.035+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:27.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:27.739+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:27.995 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:27.991+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:28.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:28.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:29.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:29.031+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:29.821 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:29.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:30.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:30.015+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:30.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:30.867+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:31.020 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:31.015+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:31.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:31.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:32.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:32.019+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:32.865 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:32.859+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:33.005 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:32.999+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:33.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:33.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:33.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:33.967+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:34.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:34.863+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:35.004 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:34.999+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:35.877 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:35.871+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:36.036 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:36.031+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:36.899 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:36.895+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:37.049 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:37.043+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:37.924 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:37.919+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:38.031 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:38.027+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:38.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:38.927+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:39.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:39.019+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:39.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:39.915+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:40.044 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:40.039+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:40.921 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:40.915+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:41.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:41.039+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:41.937 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:41.931+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:42.091 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:42.087+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:42.958 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:42.955+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:43.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:43.039+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:43.923 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:43.919+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:44.046 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:44.043+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:44.914 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:44.911+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:45.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:45.071+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:45.879 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:45.875+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:46.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:46.087+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:46.867 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:46.863+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:47.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:47.119+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:47.836 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:47.831+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:48.166 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:48.159+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:48.840 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:48.835+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:49.166 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:49.163+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:49.821 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:49.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:50.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:50.203+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:50.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:50.855+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:51.258 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:51.255+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:51.814 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:51.807+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:52.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:52.207+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:52.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:52.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:53.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:53.191+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:53.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:53.867+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:54.154 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:54.151+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:54.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:54.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:55.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:55.171+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:55.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:55.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:56.225 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:56.219+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:56.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:56.867+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:57.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:57.203+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:57.841 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:57.835+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:58.250 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:58.243+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:58.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:58.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:53:59.283 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:53:59.279+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:53:59.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:53:59.791+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:00.261 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:00.255+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:00.762 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:00.755+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:01.222 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:01.219+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:01.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:01.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:02.225 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:02.219+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:02.773 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:02.767+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:03.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:03.259+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:03.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:03.763+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:04.311 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:04.307+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:04.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:04.811+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:05.346 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:05.339+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:05.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:05.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:06.335 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:06.331+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:06.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:06.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:07.290 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:07.287+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:07.854 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:07.851+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:08.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:08.271+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:08.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:08.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:09.235 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:09.231+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:09.850 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:09.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:10.239 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:10.235+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:10.814 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:10.811+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:11.196 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:11.191+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:11.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:11.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:12.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:12.159+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:12.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:12.851+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:13.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:13.175+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:13.853 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:13.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:14.146 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:14.143+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:14.872 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:14.867+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:15.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:15.139+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:15.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:15.839+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:16.163 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:16.159+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:16.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:16.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:17.131 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:17.127+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:17.765 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:17.759+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:18.105 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:18.099+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:18.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:18.775+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:19.072 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:19.067+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:19.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:19.799+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:20.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:20.043+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:20.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:20.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:21.093 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:21.087+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:21.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:21.811+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:22.095 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:22.090+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:22.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:22.830+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:23.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:23.062+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:23.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:23.878+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:24.060 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:24.054+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:24.933 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:24.926+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:25.038 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:25.030+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:25.901 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:25.894+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:26.060 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:26.054+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:26.886 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:26.878+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:27.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:27.070+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:27.881 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:27.874+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:28.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:28.114+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:28.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:28.842+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:29.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:29.154+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:29.860 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:29.854+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:30.154 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:30.146+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:30.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:30.822+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:31.201 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:31.194+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:31.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:31.774+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:32.194 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:32.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:32.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:32.794+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:33.154 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:33.146+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:33.783 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:33.778+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:34.205 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:34.198+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:34.780 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:34.774+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:35.169 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:35.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:35.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:35.802+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:36.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:36.158+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:36.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:36.842+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:37.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:37.206+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:37.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:37.882+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:38.167 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:38.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:38.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:38.854+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:39.173 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:39.166+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:39.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:39.850+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:40.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:40.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:40.909 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:40.902+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:41.209 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:41.202+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:41.883 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:41.878+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:42.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:42.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:42.882 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:42.874+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:43.156 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:43.150+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:43.902 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:43.898+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:44.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:44.158+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:44.903 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:44.898+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:45.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:45.130+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:45.886 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:45.878+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:46.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:46.114+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:46.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:46.862+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:47.080 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:47.074+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:47.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:47.826+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:48.050 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:48.042+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:48.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:48.802+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:49.082 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:49.074+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:49.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:49.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:50.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:50.050+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:50.845 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:50.838+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:51.066 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:51.058+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:51.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:51.790+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:52.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:52.070+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:52.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:52.806+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:53.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:53.074+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:53.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:53.782+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:54.068 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:54.062+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:54.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:54.830+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:55.048 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:55.042+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:55.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:55.798+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:56.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:56.062+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:56.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:56.778+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:57.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:57.074+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:57.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:57.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:58.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:58.110+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:58.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:58.778+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:54:59.105 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:54:59.098+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:54:59.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:54:59.770+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:00.107 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:00.102+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:00.767 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:00.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:01.107 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:01.102+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:01.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:01.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:02.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:02.098+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:02.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:02.774+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:03.137 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:03.130+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:03.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:03.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:04.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:04.182+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:04.754 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:04.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:05.190 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:05.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:05.720 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:05.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:06.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:06.194+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:06.685 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:06.678+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:07.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:07.190+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:07.646 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:07.642+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:08.156 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:08.150+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:08.693 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:08.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:09.202 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:09.194+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:09.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:09.678+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:10.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:10.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:10.651 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:10.646+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:11.145 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:11.138+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:11.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:11.670+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:12.167 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:12.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:12.712 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:12.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:13.168 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:13.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:13.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:13.726+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:14.160 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:14.154+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:14.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:14.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:15.211 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:15.206+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:15.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:15.662+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:16.241 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:16.234+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:16.698 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:16.694+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:17.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:17.230+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:17.732 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:17.726+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:18.272 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:18.266+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:18.749 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:18.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:19.249 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:19.242+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:19.722 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:19.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:20.249 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:20.242+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:20.721 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:20.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:21.222 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:21.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:21.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:21.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:22.208 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:22.202+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:22.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:22.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:23.193 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:23.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:23.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:23.710+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:24.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:24.150+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:24.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:24.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:25.130 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:25.122+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:25.676 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:25.670+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:26.156 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:26.150+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:26.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:26.690+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:27.126 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:27.122+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:27.673 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:27.666+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:28.087 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:28.082+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:28.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:28.710+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:29.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:29.050+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:29.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:29.734+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:30.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:30.066+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:30.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:30.774+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:31.106 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:31.098+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:31.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:31.826+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:32.119 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:32.114+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:32.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:32.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:33.161 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:33.154+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:33.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:33.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:34.135 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:34.130+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:34.812 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:34.806+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:35.167 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:35.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:35.772 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:35.766+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:36.129 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:36.122+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:36.805 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:36.798+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:37.102 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:37.094+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:37.777 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:37.770+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:38.067 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:38.062+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:38.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:38.810+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:39.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:39.078+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:39.866 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:39.862+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:40.129 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:40.122+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:40.828 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:40.822+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:41.123 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:41.118+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:41.850 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:41.842+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:42.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:42.106+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:42.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:42.850+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:43.125 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:43.118+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:43.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:43.838+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:44.125 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:44.118+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:44.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:44.810+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:45.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:45.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:45.812 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:45.802+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:46.169 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:46.162+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:46.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:46.770+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:47.215 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:47.210+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:47.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:47.726+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:48.245 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:48.238+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:48.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:48.758+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:49.225 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:49.218+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:49.725 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:49.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:50.269 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:50.262+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:50.724 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:50.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:51.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:51.310+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:51.729 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:51.722+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:52.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:52.318+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:52.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:52.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:53.359 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:53.354+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:53.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:53.710+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:54.350 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:54.346+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:54.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:54.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:55.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:55.326+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:55.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:55.798+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:56.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:56.346+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:56.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:56.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:57.390 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:57.382+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:57.724 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:57.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:58.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:58.374+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:58.709 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:58.702+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:55:59.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:55:59.406+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:55:59.689 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:55:59.682+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:00.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:00.378+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:00.671 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:00.666+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:01.418 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:01.414+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:01.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:01.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:02.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:02.366+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:02.658 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:02.650+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:03.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:03.350+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:03.630 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:03.622+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:04.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:04.358+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:04.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:04.670+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:05.354 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:05.350+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:05.684 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:05.678+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:06.327 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:06.322+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:06.680 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:06.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:07.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:07.370+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:07.691 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:07.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:08.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:08.349+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:08.696 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:08.689+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:09.324 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:09.317+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:09.672 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:09.665+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:10.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:10.345+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:10.653 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:10.645+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:11.313 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:11.305+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:11.606 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:11.597+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:12.283 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:12.277+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:12.638 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:12.633+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:13.319 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:13.313+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:13.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:13.661+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:14.337 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:14.329+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:14.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:14.677+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:15.361 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:15.353+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:15.665 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:15.657+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:16.407 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:16.401+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:16.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:16.661+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:17.368 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:17.361+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:17.685 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:17.681+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:18.372 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:18.365+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:18.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:18.657+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:19.345 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:19.341+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:19.636 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:19.629+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:20.327 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:20.325+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:20.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:20.661+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:21.343 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:21.337+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:21.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:21.649+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:22.346 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:22.345+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:22.616 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:22.613+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:23.391 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:23.389+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:23.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:23.661+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:24.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:24.433+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:24.667 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:24.665+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:25.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:25.413+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:25.624 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:25.621+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:26.431 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:26.429+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:26.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:26.629+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:27.475 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:27.473+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:27.673 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:27.669+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:28.487 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:28.485+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:28.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:28.673+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:29.500 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:29.497+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:29.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:29.697+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:30.542 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:30.537+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:30.662 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:30.661+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:31.590 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:31.589+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:31.644 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:31.637+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:32.552 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:32.549+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:32.623 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:32.621+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:33.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:33.573+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:33.588 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:33.585+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:34.601 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:34.597+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:34.628 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:34.625+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:35.588 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:35.585+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:35.642 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:35.641+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:36.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:36.633+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:36.641 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:36.637+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:37.659 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:37.657+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:37.673 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:37.669+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:38.646 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:38.641+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:38.671 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:38.669+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:39.602 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:39.597+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:39.670 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:39.669+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:40.555 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:40.553+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:40.699 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:40.697+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:41.607 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:41.605+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:41.672 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:41.669+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:42.585 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:42.581+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:42.665 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:42.661+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:43.608 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:43.605+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:43.699 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:43.697+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:44.658 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:44.653+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:44.671 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:44.669+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:45.633 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:45.629+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:45.689 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:45.685+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:46.672 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:46.669+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:46.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:46.733+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:47.684 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:47.681+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:47.691 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:47.689+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:48.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:48.705+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:48.713 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:48.709+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:49.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:49.697+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:49.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:49.737+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:50.711 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:50.709+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:50.717 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:50.713+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:51.715 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:51.713+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:51.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:51.713+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:52.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:52.729+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:52.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:52.737+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:53.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:53.765+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:53.781 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:53.777+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:54.777 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:54.773+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:54.806 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:54.805+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:55.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:55.753+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:55.769 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:55.765+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:56.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:56.777+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:56.798 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:56.797+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:57.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:57.817+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:57.832 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:57.829+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:58.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:58.849+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:58.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:58.873+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:56:59.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:56:59.817+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:56:59.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:56:59.849+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:00.777 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:00.773+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:00.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:00.849+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:01.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:01.761+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:01.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:01.833+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:02.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:02.757+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:02.808 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:02.805+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:03.742 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:03.741+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:03.839 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:03.837+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:04.727 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:04.725+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:04.870 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:04.869+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:05.748 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:05.745+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:05.844 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:05.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:06.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:06.777+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:06.882 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:06.881+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:07.770 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:07.765+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:07.855 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:07.853+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:08.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:08.809+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:08.848 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:08.845+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:09.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:09.853+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:09.880 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:09.877+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:10.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:10.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:10.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:10.849+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:11.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:11.797+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:11.880 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:11.877+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:12.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:12.781+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:12.842 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:12.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:13.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:13.761+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:13.823 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:13.821+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:14.746 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:14.741+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:14.808 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:14.805+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:15.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:15.717+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:15.767 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:15.765+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:16.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:16.697+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:16.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:16.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:17.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:17.717+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:17.781 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:17.777+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:18.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:18.741+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:18.751 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:18.749+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:19.705 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:19.701+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:19.724 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:19.721+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:20.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:20.721+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:20.755 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:20.753+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:21.725 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:21.721+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:21.770 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:21.765+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:22.698 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:22.693+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:22.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:22.789+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:23.670 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:23.665+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:23.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:23.793+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:24.683 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:24.681+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:24.839 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:24.837+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:25.665 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:25.661+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:25.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:25.809+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:26.624 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:26.621+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:26.800 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:26.797+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:27.623 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:27.621+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:27.814 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:27.809+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:28.650 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:28.649+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:28.846 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:28.845+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:29.648 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:29.645+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:29.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:29.825+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:30.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:30.601+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:30.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:30.833+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:31.606 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:31.601+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:31.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:31.805+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:32.637 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:32.633+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:32.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:32.853+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:33.627 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:33.625+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:33.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:33.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:34.593 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:34.589+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:34.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:34.833+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:35.550 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:35.545+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:35.853 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:35.849+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:36.529 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:36.525+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:36.842 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:36.841+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:37.542 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:37.537+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:37.829 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:37.825+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:38.529 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:38.525+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:38.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:38.805+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:39.496 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:39.493+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:39.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:39.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:40.523 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:40.521+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:40.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:40.845+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:41.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:41.537+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:41.877 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:41.873+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:42.516 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:42.513+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:42.859 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:42.857+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:43.526 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:43.521+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:43.812 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:43.809+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:44.488 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:44.485+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:44.812 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:44.809+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:45.501 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:45.497+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:45.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:45.793+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:46.464 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:46.461+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:46.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:46.845+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:47.462 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:47.461+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:47.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:47.841+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:48.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:48.437+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:48.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:48.805+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:49.490 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:49.485+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:49.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:49.841+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:50.478 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:50.473+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:50.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:50.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:51.501 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:51.497+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:51.800 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:51.797+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:52.485 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:52.481+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:52.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:52.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:53.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:53.465+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:53.846 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:53.841+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:54.475 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:54.473+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:54.805 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:54.800+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:55.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:55.432+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:55.805 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:55.800+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:56.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:56.432+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:56.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:56.760+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:57.417 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:57.412+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:57.804 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:57.800+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:58.456 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:58.452+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:58.845 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:58.840+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:57:59.477 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:57:59.472+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:57:59.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:57:59.812+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:00.439 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:00.436+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:00.773 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:00.768+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:01.448 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:01.444+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:01.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:01.792+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:02.468 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:02.464+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:02.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:02.820+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:03.504 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:03.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:03.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:03.804+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:04.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:04.524+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:04.761 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:04.756+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:05.507 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:05.504+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:05.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:05.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:06.541 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:06.536+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:06.765 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:06.760+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:07.500 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:07.496+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:07.753 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:07.748+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:08.533 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:08.528+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:08.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:08.792+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:09.515 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:09.512+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:09.820 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:09.816+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:10.474 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:10.472+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:10.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:10.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:11.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:11.428+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:11.812 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:11.808+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:12.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:12.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:12.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:12.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:13.476 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:13.472+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:13.876 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:13.872+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:14.444 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:14.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:14.906 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:14.900+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:15.396 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:15.392+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:15.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:15.888+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:16.399 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:16.396+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:16.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:16.904+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:17.375 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:17.372+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:17.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:17.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:18.398 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:18.396+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:18.865 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:18.860+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:19.380 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:19.376+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:19.820 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:19.816+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:20.341 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:20.336+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:20.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:20.780+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:21.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:21.292+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:21.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:21.780+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:22.307 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:22.304+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:22.756 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:22.752+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:23.353 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:23.348+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:23.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:23.760+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:24.366 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:24.364+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:24.727 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:24.724+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:25.402 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:25.396+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:25.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:25.720+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:26.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:26.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:26.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:26.720+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:27.407 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:27.404+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:27.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:27.704+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:28.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:28.400+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:28.754 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:28.752+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:29.402 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:29.396+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:29.769 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:29.764+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:30.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:30.432+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:30.746 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:30.740+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:31.391 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:31.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:31.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:31.772+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:32.415 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:32.412+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:32.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:32.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:33.400 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:33.396+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:33.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:33.788+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:34.365 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:34.360+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:34.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:34.796+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:35.370 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:35.368+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:35.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:35.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:36.389 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:36.384+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:36.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:36.820+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:37.402 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:37.396+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:37.787 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:37.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:38.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:38.384+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:38.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:38.744+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:39.379 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:39.376+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:39.775 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:39.772+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:40.388 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:40.384+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:40.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:40.812+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:41.430 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:41.428+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:41.789 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:41.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:42.392 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:42.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:42.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:42.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:43.385 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:43.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:43.755 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:43.752+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:44.393 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:44.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:44.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:44.788+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:45.362 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:45.356+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:45.758 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:45.752+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:46.343 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:46.340+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:46.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:46.792+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:47.306 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:47.300+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:47.829 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:47.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:48.339 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:48.336+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:48.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:48.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:49.341 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:49.336+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:49.747 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:49.744+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:50.370 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:50.364+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:50.734 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:50.728+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:51.419 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:51.416+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:51.720 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:51.716+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:52.453 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:52.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:52.733 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:52.728+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:53.454 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:53.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:53.685 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:53.680+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:54.421 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:54.416+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:54.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:54.696+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:55.394 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:55.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:55.740 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:55.736+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:56.052 INFO:tasks.workunit.client.0.smithi012.stderr:2023-08-23T03:58:56.048+0000 7f19a0ff9700 -1 received signal: Terminated from timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh (PID: 33040) UID: 1000 2023-08-23T03:58:56.052 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-08-23T03:58:56.430 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:56.424+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:56.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:56.780+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:57.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:57.456+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:57.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:57.812+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:58.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:58.476+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:58.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:58.780+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:58:59.519 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:58:59.516+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:58:59.794 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:58:59.788+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:00.501 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:00.496+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:00.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:00.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:01.515 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:01.512+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:01.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:01.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:02.547 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:02.544+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:02.788 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:02.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:03.587 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:03.584+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:03.752 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:03.748+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:04.630 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:04.628+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:04.771 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:04.768+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:05.672 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:05.668+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:05.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:05.748+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:06.635 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:06.632+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:06.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:06.712+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:07.641 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:07.636+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:07.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:07.696+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:08.680 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:08.676+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:08.684 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:08.680+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:09.681 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:09.676+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:09.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:09.704+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:10.644 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:10.640+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:10.706 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:10.700+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:11.651 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:11.648+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:11.713 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:11.708+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:12.611 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:12.608+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:12.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:12.712+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:13.568 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:13.564+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:13.688 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:13.684+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:14.605 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:14.600+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:14.693 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:14.688+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:15.571 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:15.568+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:15.692 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:15.688+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:16.566 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:16.560+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:16.695 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:16.692+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:17.526 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:17.520+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:17.728 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:17.724+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:18.534 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:18.528+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:18.692 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:18.688+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:19.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:19.524+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:19.725 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:19.720+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:20.498 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:20.492+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:20.742 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:20.740+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:21.462 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:21.460+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:21.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:21.760+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:22.464 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:22.460+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:22.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:22.756+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:23.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:23.480+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:23.799 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:23.796+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:24.525 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:24.520+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:24.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:24.780+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:25.500 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:25.496+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:25.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:25.828+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:26.466 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:26.460+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:26.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:26.812+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:27.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:27.420+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:27.779 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:27.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:28.453 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:28.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:28.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:28.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:29.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:29.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:29.789 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:29.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:30.488 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:30.484+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:30.761 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:30.756+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:31.453 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:31.448+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:31.763 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:31.760+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:32.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:32.440+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:32.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:32.736+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:33.473 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:33.468+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:33.740 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:33.736+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:34.470 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:34.468+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:34.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:34.736+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:35.468 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:35.464+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:35.739 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:35.736+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:36.472 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:36.468+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:36.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:36.700+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:37.429 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:37.424+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:37.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:37.728+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:38.471 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:38.468+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:38.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:38.692+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:39.495 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:39.492+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:39.714 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:39.708+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:40.507 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:40.504+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:40.725 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:40.720+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:41.533 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:41.527+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:41.720 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:41.715+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:42.537 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:42.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:42.729 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:42.723+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:43.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:43.511+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:43.733 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:43.727+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:44.518 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:44.511+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:44.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:44.739+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:45.478 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:45.471+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:45.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:45.695+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:46.523 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:46.519+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:46.693 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:46.687+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:47.540 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:47.535+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:47.734 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:47.727+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:48.575 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:48.571+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:48.780 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:48.775+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:49.552 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:49.547+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:49.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:49.787+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:50.524 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:50.519+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:50.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:50.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:51.511 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:51.507+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:51.866 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:51.863+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:52.512 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:52.507+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:52.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:52.903+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:53.547 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:53.543+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:53.891 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:53.887+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:54.514 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:54.507+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:54.862 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:54.855+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:55.562 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:55.555+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:55.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:55.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:56.054 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-08-23T03:59:56.587 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:56.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:56.898 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:56.891+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:57.583 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:57.579+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:57.858 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:57.851+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:58.573 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:58.567+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:58.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:58.851+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T03:59:59.599 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T03:59:59.595+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T03:59:59.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T03:59:59.811+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:00.590 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:00.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:00.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:00.807+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:01.594 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:01.591+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:01.781 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:01.775+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:02.587 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:02.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:02.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:02.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:03.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:03.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:03.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:03.759+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:04.605 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:04.599+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:04.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:04.743+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:05.619 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:05.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:05.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:05.771+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:06.587 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:06.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:06.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:06.723+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:07.582 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:07.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:07.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:07.755+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:08.534 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:08.527+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:08.772 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:08.767+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:09.541 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:09.535+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:09.818 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:09.811+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:10.530 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:10.523+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:10.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:10.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:11.494 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:11.487+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:11.856 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:11.851+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:12.520 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:12.515+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:12.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:12.903+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:13.553 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:13.547+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:13.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:13.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:14.582 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:14.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:14.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:14.915+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:15.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:15.543+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:15.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:15.887+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:16.556 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:16.551+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:16.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:16.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:17.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:17.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:17.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:17.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:18.565 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:18.559+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:18.835 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:18.831+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:19.545 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:19.539+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:19.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:19.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:20.535 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:20.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:20.861 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:20.855+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:21.547 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:21.543+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:21.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:21.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:22.595 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:22.591+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:22.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:22.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:23.555 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:23.551+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:23.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:23.831+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:24.506 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:24.503+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:24.789 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:24.783+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:25.464 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:25.459+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:25.744 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:25.739+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:26.428 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:26.423+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:26.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:26.711+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:27.441 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:27.435+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:27.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:27.743+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:28.424 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:28.419+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:28.748 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:28.743+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:29.468 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:29.463+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:29.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:29.763+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:30.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:30.431+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:30.728 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:30.723+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:31.427 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:31.423+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:31.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:31.731+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:32.456 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:32.451+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:32.752 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:32.747+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:33.452 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:33.447+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:33.754 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:33.747+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:34.479 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:34.475+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:34.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:34.787+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:35.515 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:35.511+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:35.749 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:35.743+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:36.535 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:36.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:36.722 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:36.715+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:37.550 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:37.543+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:37.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:37.727+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:38.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:38.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:38.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:38.711+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:39.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:39.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:39.727 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:39.723+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:40.630 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:40.623+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:40.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:40.711+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:41.595 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:41.591+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:41.733 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:41.727+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:42.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:42.599+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:42.768 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:42.763+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:43.562 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:43.555+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:43.739 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:43.735+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:44.527 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:44.519+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:44.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:44.755+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:45.536 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:45.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:45.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:45.751+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:46.553 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:46.547+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:46.800 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:46.795+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:47.531 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:47.527+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:47.839 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:47.835+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:48.512 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:48.507+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:48.879 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:48.875+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:49.478 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:49.475+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:49.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:49.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:50.447 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:50.443+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:50.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:50.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:51.458 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:51.451+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:51.813 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:51.807+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:52.412 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:52.407+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:52.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:52.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:53.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:53.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:53.812 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:53.807+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:54.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:54.327+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:54.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:54.791+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:55.364 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:55.359+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:55.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:55.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:56.055 DEBUG:teuthology.orchestra.run:timed out waiting; will kill: 2023-08-23T04:00:56.055 INFO:tasks.workunit:Stopping ['rbd/cli_generic.sh'] on client.0... 2023-08-23T04:00:56.056 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-08-23T04:00:56.312 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa/tasks/workunit.py", line 423, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi012 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=21b2d401852937440c3da8ce2b19224181760caa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2023-08-23T04:00:56.385 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=b6a61815f2494344a19189a70029b0be Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa/tasks/workunit.py", line 129, in task p.spawn(_run_tests, ctx, refspec, role, tests, File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa/tasks/workunit.py", line 423, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/remote.py", line 522, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/cli_generic.sh) on smithi012 with status 124: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=21b2d401852937440c3da8ce2b19224181760caa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh' 2023-08-23T04:00:56.388 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-08-23T04:00:56.410 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-08-23T04:00:56.411 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-23T04:00:56.416 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:56.407+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:56.705 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:00:56.705 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":160,"fsid":"60709aa8-8ef6-453d-a210-09a154c4f279","created":"2023-08-23T00:57:45.840621+0000","modified":"2023-08-23T02:02:02.368591+0000","last_up_change":"2023-08-23T00:57:53.011690+0000","last_in_change":"2023-08-23T00:57:46.635969+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-23T00:57:53.086533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-23T00:57:54.275193+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"16","last_force_op_resend_prenautilus":"16","last_force_op_resend_preluminous":"16","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":156,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2023-08-23T00:58:00.887327+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"16","last_force_op_resend_prenautilus":"16","last_force_op_resend_preluminous":"16","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":156,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"82094578-8914-447d-9b0d-98e9427ad2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":29704},{"type":"v1","addr":"172.21.15.12:6801","nonce":29704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":29704},{"type":"v1","addr":"172.21.15.12:6803","nonce":29704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":29704},{"type":"v1","addr":"172.21.15.12:6807","nonce":29704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":29704},{"type":"v1","addr":"172.21.15.12:6805","nonce":29704}]},"public_addr":"172.21.15.12:6801/29704","cluster_addr":"172.21.15.12:6803/29704","heartbeat_back_addr":"172.21.15.12:6807/29704","heartbeat_front_addr":"172.21.15.12:6805/29704","state":["exists","up"]},{"osd":1,"uuid":"bdcaa971-caac-4af7-aab0-0cb779d7789d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":29703},{"type":"v1","addr":"172.21.15.12:6809","nonce":29703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":29703},{"type":"v1","addr":"172.21.15.12:6811","nonce":29703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":29703},{"type":"v1","addr":"172.21.15.12:6815","nonce":29703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":29703},{"type":"v1","addr":"172.21.15.12:6813","nonce":29703}]},"public_addr":"172.21.15.12:6809/29703","cluster_addr":"172.21.15.12:6811/29703","heartbeat_back_addr":"172.21.15.12:6815/29703","heartbeat_front_addr":"172.21.15.12:6813/29703","state":["exists","up"]},{"osd":2,"uuid":"9193f857-84af-48a5-beb2-57513930d5d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":29705},{"type":"v1","addr":"172.21.15.12:6817","nonce":29705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":29705},{"type":"v1","addr":"172.21.15.12:6819","nonce":29705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":29705},{"type":"v1","addr":"172.21.15.12:6823","nonce":29705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":29705},{"type":"v1","addr":"172.21.15.12:6821","nonce":29705}]},"public_addr":"172.21.15.12:6817/29705","cluster_addr":"172.21.15.12:6819/29705","heartbeat_back_addr":"172.21.15.12:6823/29705","heartbeat_front_addr":"172.21.15.12:6821/29705","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-23T00:57:51.810767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-23T00:57:51.685306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-23T00:57:51.897262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":4,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":7,"snaps":[{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-23T04:00:56.719 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-23T04:00:56.720 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:00:56.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:56.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:56.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:00:56.998 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:00:57.009 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5649,"stamp":"2023-08-23T04:00:56.916851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29991,"ondisk_log_size":29991,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1391112,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":903936,"kb_avail":281724408,"statfs":{"total":289910292480,"available":288485793792,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":925630464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003176"},"pg_stats":[{"pgid":"2.7","version":"157'1339","reported_seq":2237,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374849+0000","last_change":"2023-08-23T01:03:37.985948+0000","last_active":"2023-08-23T02:01:57.374849+0000","last_peered":"2023-08-23T02:01:57.374849+0000","last_clean":"2023-08-23T02:01:57.374849+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T02:01:57.374849+0000","last_undegraded":"2023-08-23T02:01:57.374849+0000","last_fullsized":"2023-08-23T02:01:57.374849+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"157'1472","reported_seq":2396,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374529+0000","last_change":"2023-08-23T01:03:37.986170+0000","last_active":"2023-08-23T02:01:57.374529+0000","last_peered":"2023-08-23T02:01:57.374529+0000","last_clean":"2023-08-23T02:01:57.374529+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T02:01:57.374529+0000","last_undegraded":"2023-08-23T02:01:57.374529+0000","last_fullsized":"2023-08-23T02:01:57.374529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1472,"ondisk_log_size":1472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"157'1112","reported_seq":2005,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374427+0000","last_change":"2023-08-23T01:03:37.985688+0000","last_active":"2023-08-23T02:01:57.374427+0000","last_peered":"2023-08-23T02:01:57.374427+0000","last_clean":"2023-08-23T02:01:57.374427+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T02:01:57.374427+0000","last_undegraded":"2023-08-23T02:01:57.374427+0000","last_fullsized":"2023-08-23T02:01:57.374427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1112,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"157'1550","reported_seq":2403,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374610+0000","last_change":"2023-08-23T01:03:37.986313+0000","last_active":"2023-08-23T02:01:57.374610+0000","last_peered":"2023-08-23T02:01:57.374610+0000","last_clean":"2023-08-23T02:01:57.374610+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T02:01:57.374610+0000","last_undegraded":"2023-08-23T02:01:57.374610+0000","last_fullsized":"2023-08-23T02:01:57.374610+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1550,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"157'5767","reported_seq":13084,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374695+0000","last_change":"2023-08-23T01:03:37.980433+0000","last_active":"2023-08-23T02:01:57.374695+0000","last_peered":"2023-08-23T02:01:57.374695+0000","last_clean":"2023-08-23T02:01:57.374695+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T02:01:57.374695+0000","last_undegraded":"2023-08-23T02:01:57.374695+0000","last_fullsized":"2023-08-23T02:01:57.374695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":5767,"ondisk_log_size":5767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"157'1464","reported_seq":2423,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374346+0000","last_change":"2023-08-23T01:03:37.980228+0000","last_active":"2023-08-23T02:01:57.374346+0000","last_peered":"2023-08-23T02:01:57.374346+0000","last_clean":"2023-08-23T02:01:57.374346+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T02:01:57.374346+0000","last_undegraded":"2023-08-23T02:01:57.374346+0000","last_fullsized":"2023-08-23T02:01:57.374346+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1464,"ondisk_log_size":1464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"157'4889","reported_seq":11141,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373392+0000","last_change":"2023-08-23T01:03:37.990362+0000","last_active":"2023-08-23T02:01:57.373392+0000","last_peered":"2023-08-23T02:01:57.373392+0000","last_clean":"2023-08-23T02:01:57.373392+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T02:01:57.373392+0000","last_undegraded":"2023-08-23T02:01:57.373392+0000","last_fullsized":"2023-08-23T02:01:57.373392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4889,"ondisk_log_size":4889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"157'1129","reported_seq":2092,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373425+0000","last_change":"2023-08-23T01:03:37.988894+0000","last_active":"2023-08-23T02:01:57.373425+0000","last_peered":"2023-08-23T02:01:57.373425+0000","last_clean":"2023-08-23T02:01:57.373425+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T02:01:57.373425+0000","last_undegraded":"2023-08-23T02:01:57.373425+0000","last_fullsized":"2023-08-23T02:01:57.373425+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1129,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"157'3244","reported_seq":8243,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374344+0000","last_change":"2023-08-23T01:03:37.981619+0000","last_active":"2023-08-23T02:01:57.374344+0000","last_peered":"2023-08-23T02:01:57.374344+0000","last_clean":"2023-08-23T02:01:57.374344+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T02:01:57.374344+0000","last_undegraded":"2023-08-23T02:01:57.374344+0000","last_fullsized":"2023-08-23T02:01:57.374344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":3244,"ondisk_log_size":3244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"157'1844","reported_seq":2748,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373122+0000","last_change":"2023-08-23T01:03:37.990558+0000","last_active":"2023-08-23T02:01:57.373122+0000","last_peered":"2023-08-23T02:01:57.373122+0000","last_clean":"2023-08-23T02:01:57.373122+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T02:01:57.373122+0000","last_undegraded":"2023-08-23T02:01:57.373122+0000","last_fullsized":"2023-08-23T02:01:57.373122+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1844,"ondisk_log_size":1844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"157'1847","reported_seq":2910,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374325+0000","last_change":"2023-08-23T01:03:37.985526+0000","last_active":"2023-08-23T02:01:57.374325+0000","last_peered":"2023-08-23T02:01:57.374325+0000","last_clean":"2023-08-23T02:01:57.374325+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T02:01:57.374325+0000","last_undegraded":"2023-08-23T02:01:57.374325+0000","last_fullsized":"2023-08-23T02:01:57.374325+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1847,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373852+0000","last_change":"2023-08-23T00:57:55.042710+0000","last_active":"2023-08-23T02:01:57.373852+0000","last_peered":"2023-08-23T02:01:57.373852+0000","last_clean":"2023-08-23T02:01:57.373852+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T02:01:57.373852+0000","last_undegraded":"2023-08-23T02:01:57.373852+0000","last_fullsized":"2023-08-23T02:01:57.373852+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_clean_scrub_stamp":"2023-08-23T00:57:54.020645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18234,"ondisk_log_size":18234,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11757,"ondisk_log_size":11757,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740573,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451224,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93920616,"statfs":{"total":96636764160,"available":96174710784,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.45000000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.72999999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.495,"5min":0.45400000000000001,"15min":0.442},"max":{"1min":0.67700000000000005,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.54300000000000004}]},{"osd":1,"last update":"Wed Aug 23 04:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.45800000000000002},"max":{"1min":0.66900000000000004,"5min":0.77600000000000002,"15min":0.79200000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":0.76000000000000001,"5min":0.79400000000000004,"15min":0.84599999999999997},"last":0.66100000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740570,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":502516,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93869324,"statfs":{"total":96636764160,"available":96122187776,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 03:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.38700000000000001},"max":{"1min":0.68400000000000005,"5min":0.73499999999999999,"15min":0.82699999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69099999999999995,"15min":0.67900000000000005},"min":{"1min":0.65200000000000002,"5min":0.53400000000000003,"15min":0.46200000000000002},"max":{"1min":0.78200000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.70299999999999996}]},{"osd":2,"last update":"Wed Aug 23 04:00:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56599999999999995,"15min":0.58999999999999997},"min":{"1min":0.48799999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.624,"5min":0.69599999999999995,"15min":0.80800000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.53800000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.747,"5min":0.752,"15min":1.0049999999999999},"last":0.61499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740569,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.51500000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.748},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.51400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65900000000000003,"5min":0.83499999999999996,"15min":0.871},"last":0.55500000000000005}]},{"osd":2,"last update":"Wed Aug 23 04:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.52400000000000002,"5min":0.47599999999999998,"15min":0.42399999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.66900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:00:57.010 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:00:57.292 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:00:57.296 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:00:57.307 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5649,"stamp":"2023-08-23T04:00:56.916851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29991,"ondisk_log_size":29991,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1391112,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":903936,"kb_avail":281724408,"statfs":{"total":289910292480,"available":288485793792,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":925630464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003176"},"pg_stats":[{"pgid":"2.7","version":"157'1339","reported_seq":2237,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374849+0000","last_change":"2023-08-23T01:03:37.985948+0000","last_active":"2023-08-23T02:01:57.374849+0000","last_peered":"2023-08-23T02:01:57.374849+0000","last_clean":"2023-08-23T02:01:57.374849+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T02:01:57.374849+0000","last_undegraded":"2023-08-23T02:01:57.374849+0000","last_fullsized":"2023-08-23T02:01:57.374849+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"157'1472","reported_seq":2396,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374529+0000","last_change":"2023-08-23T01:03:37.986170+0000","last_active":"2023-08-23T02:01:57.374529+0000","last_peered":"2023-08-23T02:01:57.374529+0000","last_clean":"2023-08-23T02:01:57.374529+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T02:01:57.374529+0000","last_undegraded":"2023-08-23T02:01:57.374529+0000","last_fullsized":"2023-08-23T02:01:57.374529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1472,"ondisk_log_size":1472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"157'1112","reported_seq":2005,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374427+0000","last_change":"2023-08-23T01:03:37.985688+0000","last_active":"2023-08-23T02:01:57.374427+0000","last_peered":"2023-08-23T02:01:57.374427+0000","last_clean":"2023-08-23T02:01:57.374427+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T02:01:57.374427+0000","last_undegraded":"2023-08-23T02:01:57.374427+0000","last_fullsized":"2023-08-23T02:01:57.374427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1112,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"157'1550","reported_seq":2403,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374610+0000","last_change":"2023-08-23T01:03:37.986313+0000","last_active":"2023-08-23T02:01:57.374610+0000","last_peered":"2023-08-23T02:01:57.374610+0000","last_clean":"2023-08-23T02:01:57.374610+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T02:01:57.374610+0000","last_undegraded":"2023-08-23T02:01:57.374610+0000","last_fullsized":"2023-08-23T02:01:57.374610+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1550,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"157'5767","reported_seq":13084,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374695+0000","last_change":"2023-08-23T01:03:37.980433+0000","last_active":"2023-08-23T02:01:57.374695+0000","last_peered":"2023-08-23T02:01:57.374695+0000","last_clean":"2023-08-23T02:01:57.374695+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T02:01:57.374695+0000","last_undegraded":"2023-08-23T02:01:57.374695+0000","last_fullsized":"2023-08-23T02:01:57.374695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":5767,"ondisk_log_size":5767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"157'1464","reported_seq":2423,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374346+0000","last_change":"2023-08-23T01:03:37.980228+0000","last_active":"2023-08-23T02:01:57.374346+0000","last_peered":"2023-08-23T02:01:57.374346+0000","last_clean":"2023-08-23T02:01:57.374346+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T02:01:57.374346+0000","last_undegraded":"2023-08-23T02:01:57.374346+0000","last_fullsized":"2023-08-23T02:01:57.374346+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1464,"ondisk_log_size":1464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"157'4889","reported_seq":11141,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373392+0000","last_change":"2023-08-23T01:03:37.990362+0000","last_active":"2023-08-23T02:01:57.373392+0000","last_peered":"2023-08-23T02:01:57.373392+0000","last_clean":"2023-08-23T02:01:57.373392+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T02:01:57.373392+0000","last_undegraded":"2023-08-23T02:01:57.373392+0000","last_fullsized":"2023-08-23T02:01:57.373392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4889,"ondisk_log_size":4889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"157'1129","reported_seq":2092,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373425+0000","last_change":"2023-08-23T01:03:37.988894+0000","last_active":"2023-08-23T02:01:57.373425+0000","last_peered":"2023-08-23T02:01:57.373425+0000","last_clean":"2023-08-23T02:01:57.373425+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T02:01:57.373425+0000","last_undegraded":"2023-08-23T02:01:57.373425+0000","last_fullsized":"2023-08-23T02:01:57.373425+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1129,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"157'3244","reported_seq":8243,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374344+0000","last_change":"2023-08-23T01:03:37.981619+0000","last_active":"2023-08-23T02:01:57.374344+0000","last_peered":"2023-08-23T02:01:57.374344+0000","last_clean":"2023-08-23T02:01:57.374344+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T02:01:57.374344+0000","last_undegraded":"2023-08-23T02:01:57.374344+0000","last_fullsized":"2023-08-23T02:01:57.374344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":3244,"ondisk_log_size":3244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"157'1844","reported_seq":2748,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373122+0000","last_change":"2023-08-23T01:03:37.990558+0000","last_active":"2023-08-23T02:01:57.373122+0000","last_peered":"2023-08-23T02:01:57.373122+0000","last_clean":"2023-08-23T02:01:57.373122+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T02:01:57.373122+0000","last_undegraded":"2023-08-23T02:01:57.373122+0000","last_fullsized":"2023-08-23T02:01:57.373122+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1844,"ondisk_log_size":1844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"157'1847","reported_seq":2910,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374325+0000","last_change":"2023-08-23T01:03:37.985526+0000","last_active":"2023-08-23T02:01:57.374325+0000","last_peered":"2023-08-23T02:01:57.374325+0000","last_clean":"2023-08-23T02:01:57.374325+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T02:01:57.374325+0000","last_undegraded":"2023-08-23T02:01:57.374325+0000","last_fullsized":"2023-08-23T02:01:57.374325+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1847,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373852+0000","last_change":"2023-08-23T00:57:55.042710+0000","last_active":"2023-08-23T02:01:57.373852+0000","last_peered":"2023-08-23T02:01:57.373852+0000","last_clean":"2023-08-23T02:01:57.373852+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T02:01:57.373852+0000","last_undegraded":"2023-08-23T02:01:57.373852+0000","last_fullsized":"2023-08-23T02:01:57.373852+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_clean_scrub_stamp":"2023-08-23T00:57:54.020645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18234,"ondisk_log_size":18234,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11757,"ondisk_log_size":11757,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740573,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451224,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93920616,"statfs":{"total":96636764160,"available":96174710784,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.45000000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.72999999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.495,"5min":0.45400000000000001,"15min":0.442},"max":{"1min":0.67700000000000005,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.54300000000000004}]},{"osd":1,"last update":"Wed Aug 23 04:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.45800000000000002},"max":{"1min":0.66900000000000004,"5min":0.77600000000000002,"15min":0.79200000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":0.76000000000000001,"5min":0.79400000000000004,"15min":0.84599999999999997},"last":0.66100000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740570,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":502516,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93869324,"statfs":{"total":96636764160,"available":96122187776,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 03:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.38700000000000001},"max":{"1min":0.68400000000000005,"5min":0.73499999999999999,"15min":0.82699999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69099999999999995,"15min":0.67900000000000005},"min":{"1min":0.65200000000000002,"5min":0.53400000000000003,"15min":0.46200000000000002},"max":{"1min":0.78200000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.70299999999999996}]},{"osd":2,"last update":"Wed Aug 23 04:00:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56599999999999995,"15min":0.58999999999999997},"min":{"1min":0.48799999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.624,"5min":0.69599999999999995,"15min":0.80800000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.53800000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.747,"5min":0.752,"15min":1.0049999999999999},"last":0.61499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740569,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.51500000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.748},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.51400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65900000000000003,"5min":0.83499999999999996,"15min":0.871},"last":0.55500000000000005}]},{"osd":2,"last update":"Wed Aug 23 04:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.52400000000000002,"5min":0.47599999999999998,"15min":0.42399999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.66900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:00:57.309 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-23T04:00:57.310 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:00:57.415 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:57.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:57.592 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:00:57.595 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:00:57.606 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5649,"stamp":"2023-08-23T04:00:56.916851+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29991,"ondisk_log_size":29991,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1391112,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":903936,"kb_avail":281724408,"statfs":{"total":289910292480,"available":288485793792,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":925630464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003176"},"pg_stats":[{"pgid":"2.7","version":"157'1339","reported_seq":2237,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374849+0000","last_change":"2023-08-23T01:03:37.985948+0000","last_active":"2023-08-23T02:01:57.374849+0000","last_peered":"2023-08-23T02:01:57.374849+0000","last_clean":"2023-08-23T02:01:57.374849+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T02:01:57.374849+0000","last_undegraded":"2023-08-23T02:01:57.374849+0000","last_fullsized":"2023-08-23T02:01:57.374849+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"157'1472","reported_seq":2396,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374529+0000","last_change":"2023-08-23T01:03:37.986170+0000","last_active":"2023-08-23T02:01:57.374529+0000","last_peered":"2023-08-23T02:01:57.374529+0000","last_clean":"2023-08-23T02:01:57.374529+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T02:01:57.374529+0000","last_undegraded":"2023-08-23T02:01:57.374529+0000","last_fullsized":"2023-08-23T02:01:57.374529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1472,"ondisk_log_size":1472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"157'1112","reported_seq":2005,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374427+0000","last_change":"2023-08-23T01:03:37.985688+0000","last_active":"2023-08-23T02:01:57.374427+0000","last_peered":"2023-08-23T02:01:57.374427+0000","last_clean":"2023-08-23T02:01:57.374427+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T02:01:57.374427+0000","last_undegraded":"2023-08-23T02:01:57.374427+0000","last_fullsized":"2023-08-23T02:01:57.374427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1112,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"157'1550","reported_seq":2403,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374610+0000","last_change":"2023-08-23T01:03:37.986313+0000","last_active":"2023-08-23T02:01:57.374610+0000","last_peered":"2023-08-23T02:01:57.374610+0000","last_clean":"2023-08-23T02:01:57.374610+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T02:01:57.374610+0000","last_undegraded":"2023-08-23T02:01:57.374610+0000","last_fullsized":"2023-08-23T02:01:57.374610+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1550,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"157'5767","reported_seq":13084,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374695+0000","last_change":"2023-08-23T01:03:37.980433+0000","last_active":"2023-08-23T02:01:57.374695+0000","last_peered":"2023-08-23T02:01:57.374695+0000","last_clean":"2023-08-23T02:01:57.374695+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T02:01:57.374695+0000","last_undegraded":"2023-08-23T02:01:57.374695+0000","last_fullsized":"2023-08-23T02:01:57.374695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":5767,"ondisk_log_size":5767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"157'1464","reported_seq":2423,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374346+0000","last_change":"2023-08-23T01:03:37.980228+0000","last_active":"2023-08-23T02:01:57.374346+0000","last_peered":"2023-08-23T02:01:57.374346+0000","last_clean":"2023-08-23T02:01:57.374346+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T02:01:57.374346+0000","last_undegraded":"2023-08-23T02:01:57.374346+0000","last_fullsized":"2023-08-23T02:01:57.374346+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1464,"ondisk_log_size":1464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"157'4889","reported_seq":11141,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373392+0000","last_change":"2023-08-23T01:03:37.990362+0000","last_active":"2023-08-23T02:01:57.373392+0000","last_peered":"2023-08-23T02:01:57.373392+0000","last_clean":"2023-08-23T02:01:57.373392+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T02:01:57.373392+0000","last_undegraded":"2023-08-23T02:01:57.373392+0000","last_fullsized":"2023-08-23T02:01:57.373392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4889,"ondisk_log_size":4889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"157'1129","reported_seq":2092,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373425+0000","last_change":"2023-08-23T01:03:37.988894+0000","last_active":"2023-08-23T02:01:57.373425+0000","last_peered":"2023-08-23T02:01:57.373425+0000","last_clean":"2023-08-23T02:01:57.373425+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T02:01:57.373425+0000","last_undegraded":"2023-08-23T02:01:57.373425+0000","last_fullsized":"2023-08-23T02:01:57.373425+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1129,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"157'3244","reported_seq":8243,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374344+0000","last_change":"2023-08-23T01:03:37.981619+0000","last_active":"2023-08-23T02:01:57.374344+0000","last_peered":"2023-08-23T02:01:57.374344+0000","last_clean":"2023-08-23T02:01:57.374344+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T02:01:57.374344+0000","last_undegraded":"2023-08-23T02:01:57.374344+0000","last_fullsized":"2023-08-23T02:01:57.374344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":3244,"ondisk_log_size":3244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"157'1844","reported_seq":2748,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373122+0000","last_change":"2023-08-23T01:03:37.990558+0000","last_active":"2023-08-23T02:01:57.373122+0000","last_peered":"2023-08-23T02:01:57.373122+0000","last_clean":"2023-08-23T02:01:57.373122+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T02:01:57.373122+0000","last_undegraded":"2023-08-23T02:01:57.373122+0000","last_fullsized":"2023-08-23T02:01:57.373122+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1844,"ondisk_log_size":1844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"157'1847","reported_seq":2910,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374325+0000","last_change":"2023-08-23T01:03:37.985526+0000","last_active":"2023-08-23T02:01:57.374325+0000","last_peered":"2023-08-23T02:01:57.374325+0000","last_clean":"2023-08-23T02:01:57.374325+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T02:01:57.374325+0000","last_undegraded":"2023-08-23T02:01:57.374325+0000","last_fullsized":"2023-08-23T02:01:57.374325+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1847,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373852+0000","last_change":"2023-08-23T00:57:55.042710+0000","last_active":"2023-08-23T02:01:57.373852+0000","last_peered":"2023-08-23T02:01:57.373852+0000","last_clean":"2023-08-23T02:01:57.373852+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T02:01:57.373852+0000","last_undegraded":"2023-08-23T02:01:57.373852+0000","last_fullsized":"2023-08-23T02:01:57.373852+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_clean_scrub_stamp":"2023-08-23T00:57:54.020645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18234,"ondisk_log_size":18234,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11757,"ondisk_log_size":11757,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740573,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451224,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93920616,"statfs":{"total":96636764160,"available":96174710784,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.53300000000000003},"min":{"1min":0.45000000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.72999999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.57999999999999996,"15min":0.57499999999999996},"min":{"1min":0.495,"5min":0.45400000000000001,"15min":0.442},"max":{"1min":0.67700000000000005,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.54300000000000004}]},{"osd":1,"last update":"Wed Aug 23 04:00:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57799999999999996,"15min":0.57099999999999995},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.45800000000000002},"max":{"1min":0.66900000000000004,"5min":0.77600000000000002,"15min":0.79200000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.66100000000000003},"min":{"1min":0.57699999999999996,"5min":0.54800000000000004,"15min":0.52200000000000002},"max":{"1min":0.76000000000000001,"5min":0.79400000000000004,"15min":0.84599999999999997},"last":0.66100000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740570,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":502516,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93869324,"statfs":{"total":96636764160,"available":96122187776,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 03:59:58 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.44800000000000001,"5min":0.42399999999999999,"15min":0.38700000000000001},"max":{"1min":0.68400000000000005,"5min":0.73499999999999999,"15min":0.82699999999999996},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.69099999999999995,"15min":0.67900000000000005},"min":{"1min":0.65200000000000002,"5min":0.53400000000000003,"15min":0.46200000000000002},"max":{"1min":0.78200000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.70299999999999996}]},{"osd":2,"last update":"Wed Aug 23 04:00:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.56599999999999995,"15min":0.58999999999999997},"min":{"1min":0.48799999999999999,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.624,"5min":0.69599999999999995,"15min":0.80800000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.60999999999999999},"min":{"1min":0.53800000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.747,"5min":0.752,"15min":1.0049999999999999},"last":0.61499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740569,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:00:14 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51200000000000001,"15min":0.51500000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.748},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56100000000000005,"15min":0.56599999999999995},"min":{"1min":0.51400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.65900000000000003,"5min":0.83499999999999996,"15min":0.871},"last":0.55500000000000005}]},{"osd":2,"last update":"Wed Aug 23 04:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.52400000000000002,"5min":0.47599999999999998,"15min":0.42399999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66900000000000004,"15min":0.66300000000000003},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.66900000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:00:57.608 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-23T04:00:57.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:57.811+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:57.876 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:00:57.877 INFO:teuthology.orchestra.run.smithi012.stdout:{"epoch":160,"fsid":"60709aa8-8ef6-453d-a210-09a154c4f279","created":"2023-08-23T00:57:45.840621+0000","modified":"2023-08-23T02:02:02.368591+0000","last_up_change":"2023-08-23T00:57:53.011690+0000","last_in_change":"2023-08-23T00:57:46.635969+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2023-08-23T00:57:53.086533+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-08-23T00:57:54.275193+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"16","last_force_op_resend_prenautilus":"16","last_force_op_resend_preluminous":"16","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":156,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[3],"tier_of":-1,"read_tier":3,"write_tier":3,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cache","create_time":"2023-08-23T00:58:00.887327+0000","flags":8201,"flags_names":"hashpspool,incomplete_clones,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"16","last_force_op_resend_prenautilus":"16","last_force_op_resend_preluminous":"16","auid":0,"snap_mode":"selfmanaged","snap_seq":91,"snap_epoch":156,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":2,"read_tier":-1,"write_tier":-1,"cache_mode":"writeback","target_max_bytes":0,"target_max_objects":250,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"bloom","false_positive_probability":0.050000000000000003,"target_size":0,"seed":0},"hit_set_period":60,"hit_set_count":8,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[1000000,1000000,1000000,1000000,1000000,1000000,1000000,1000000],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"82094578-8914-447d-9b0d-98e9427ad2ab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6800","nonce":29704},{"type":"v1","addr":"172.21.15.12:6801","nonce":29704}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6802","nonce":29704},{"type":"v1","addr":"172.21.15.12:6803","nonce":29704}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6806","nonce":29704},{"type":"v1","addr":"172.21.15.12:6807","nonce":29704}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6804","nonce":29704},{"type":"v1","addr":"172.21.15.12:6805","nonce":29704}]},"public_addr":"172.21.15.12:6801/29704","cluster_addr":"172.21.15.12:6803/29704","heartbeat_back_addr":"172.21.15.12:6807/29704","heartbeat_front_addr":"172.21.15.12:6805/29704","state":["exists","up"]},{"osd":1,"uuid":"bdcaa971-caac-4af7-aab0-0cb779d7789d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6808","nonce":29703},{"type":"v1","addr":"172.21.15.12:6809","nonce":29703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6810","nonce":29703},{"type":"v1","addr":"172.21.15.12:6811","nonce":29703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6814","nonce":29703},{"type":"v1","addr":"172.21.15.12:6815","nonce":29703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6812","nonce":29703},{"type":"v1","addr":"172.21.15.12:6813","nonce":29703}]},"public_addr":"172.21.15.12:6809/29703","cluster_addr":"172.21.15.12:6811/29703","heartbeat_back_addr":"172.21.15.12:6815/29703","heartbeat_front_addr":"172.21.15.12:6813/29703","state":["exists","up"]},{"osd":2,"uuid":"9193f857-84af-48a5-beb2-57513930d5d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6816","nonce":29705},{"type":"v1","addr":"172.21.15.12:6817","nonce":29705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6818","nonce":29705},{"type":"v1","addr":"172.21.15.12:6819","nonce":29705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6822","nonce":29705},{"type":"v1","addr":"172.21.15.12:6823","nonce":29705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.12:6820","nonce":29705},{"type":"v1","addr":"172.21.15.12:6821","nonce":29705}]},"public_addr":"172.21.15.12:6817/29705","cluster_addr":"172.21.15.12:6819/29705","heartbeat_back_addr":"172.21.15.12:6823/29705","heartbeat_front_addr":"172.21.15.12:6821/29705","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-23T00:57:51.810767+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-23T00:57:51.685306+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2023-08-23T00:57:51.897262+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":4,"snaps":[{"begin":4,"length":1}]},{"pool":5,"snaps":[{"begin":2,"length":1},{"begin":4,"length":1}]},{"pool":7,"snaps":[{"begin":4,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-23T04:00:58.394 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:58.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:58.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:58.839+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:00:58.891 INFO:tasks.ceph:Scrubbing osd.0 2023-08-23T04:00:58.892 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-08-23T04:00:59.418 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:00:59.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:00:59.887 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:00:59.883+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:00.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:00.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:00.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:00.851+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:01.363 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:01.359+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:01.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:01.851+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:02.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:02.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:02.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:02.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:03.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:03.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:03.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:03.787+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:04.415 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:04.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:04.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:04.803+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:05.381 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:05.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:05.802 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:05.795+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:06.344 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:06.339+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:06.824 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:06.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:07.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:07.355+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:07.780 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:07.775+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:08.361 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:08.355+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:08.734 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:08.727+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:09.337 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:09.331+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:09.731 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:09.727+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:10.288 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:10.283+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:10.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:10.767+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:11.247 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:11.243+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:11.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:11.807+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:12.216 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:12.211+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:12.768 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:12.763+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:13.186 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:13.179+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:13.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:13.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:14.167 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:14.163+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:14.821 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:14.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:15.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:15.175+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:15.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:15.839+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:16.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:16.175+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:16.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:16.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:17.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:17.227+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:17.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:17.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:18.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:18.183+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:18.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:18.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:19.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:19.135+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:19.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:19.791+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:20.128 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:20.123+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:20.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:20.791+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:21.145 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:21.139+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:21.775 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:21.771+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:22.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:22.095+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:22.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:22.755+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:23.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:23.107+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:23.788 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:23.783+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:24.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:24.135+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:24.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:24.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:25.175 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:25.171+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:25.805 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:25.799+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:26.206 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:26.199+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:26.770 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:26.763+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:27.225 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:27.219+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:27.724 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:27.719+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:28.195 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:28.191+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:28.687 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:28.682+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:29.208 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:29.202+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:29.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:29.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:30.180 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:30.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:30.725 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:30.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:31.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:31.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:31.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:31.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:32.200 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:32.194+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:32.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:32.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:33.223 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:33.218+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:33.757 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:33.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:34.177 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:34.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:34.798 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:34.794+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:35.176 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:35.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:35.762 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:35.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:36.207 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:36.202+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:36.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:36.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:37.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:37.230+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:37.741 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:37.734+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:38.216 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:38.206+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:38.693 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:38.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:39.192 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:39.186+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:39.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:39.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:40.164 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:40.158+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:40.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:40.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:41.157 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:41.150+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:41.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:41.794+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:42.181 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:42.174+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:42.846 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:42.842+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:43.225 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:43.218+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:43.815 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:43.810+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:44.271 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:44.266+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:44.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:44.846+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:45.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:45.262+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:45.805 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:45.798+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:46.284 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:46.278+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:46.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:46.846+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:47.252 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:47.246+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:47.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:47.826+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:48.258 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:48.250+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:48.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:48.830+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:49.247 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:49.242+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:49.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:49.842+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:50.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:50.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:50.799 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:50.794+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:51.275 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:51.270+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:51.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:51.798+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:52.313 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:52.306+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:52.775 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:52.770+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:53.335 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:53.330+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:53.770 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:53.766+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:54.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:54.310+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:54.771 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:54.766+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:55.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:55.270+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:55.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:55.770+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:56.273 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:56.266+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:56.742 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:56.734+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:57.247 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:57.242+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:57.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:57.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:58.266 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:58.258+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:58.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:58.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:01:59.263 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:01:59.258+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:01:59.712 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:01:59.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:00.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:00.262+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:00.687 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:00.682+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:01.222 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:01.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:01.677 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:01.670+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:02.210 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:02.202+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:02.684 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:02.678+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:03.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:03.222+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:03.684 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:03.678+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:04.228 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:04.222+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:04.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:04.690+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:05.236 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:05.230+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:05.736 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:05.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:06.255 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:06.250+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:06.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:06.694+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:07.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:07.286+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:07.676 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:07.670+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:08.293 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:08.286+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:08.681 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:08.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:09.271 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:09.266+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:09.719 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:09.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:10.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:10.254+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:10.748 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:10.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:11.300 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:11.294+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:11.713 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:11.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:12.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:12.290+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:12.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:12.710+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:13.342 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:13.334+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:13.768 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:13.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:14.301 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:14.294+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:14.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:14.810+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:15.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:15.258+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:15.810 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:15.802+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:16.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:16.258+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:16.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:16.770+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:17.305 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:17.298+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:17.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:17.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:18.265 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:18.258+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:18.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:18.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:19.257 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:19.250+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:19.684 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:19.678+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:20.263 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:20.258+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:20.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:20.694+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:21.284 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:21.278+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:21.728 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:21.722+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:22.239 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:22.234+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:22.727 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:22.722+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:23.271 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:23.266+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:23.750 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:23.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:24.247 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:24.242+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:24.749 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:24.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:25.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:25.222+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:25.707 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:25.702+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:26.234 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:26.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:26.662 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:26.658+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:27.260 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:27.254+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:27.678 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:27.670+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:28.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:28.222+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:28.635 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:28.630+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:29.183 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:29.178+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:29.621 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:29.614+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:30.208 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:30.202+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:30.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:30.598+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:31.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:31.198+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:31.595 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:31.590+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:32.235 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:32.230+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:32.612 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:32.606+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:33.245 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:33.238+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:33.617 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:33.610+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:34.245 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:34.238+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:34.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:34.658+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:35.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:35.286+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:35.660 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:35.654+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:36.341 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:36.334+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:36.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:36.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:37.369 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:37.362+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:37.713 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:37.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:38.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:38.326+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:38.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:38.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:39.296 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:39.290+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:39.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:39.722+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:40.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:40.278+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:40.688 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:40.682+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:41.239 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:41.234+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:41.659 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:41.654+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:42.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:42.254+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:42.691 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:42.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:43.301 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:43.294+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:43.696 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:43.690+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:44.297 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:44.290+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:44.687 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:44.682+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:45.260 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:45.254+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:45.708 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:45.702+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:46.272 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:46.266+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:46.712 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:46.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:47.234 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:47.226+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:47.686 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:47.678+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:48.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:48.222+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:48.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:48.662+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:49.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:49.214+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:49.632 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:49.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:50.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:50.182+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:50.612 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:50.606+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:51.160 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:51.154+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:51.640 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:51.634+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:52.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:52.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:52.671 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:52.662+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:53.155 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:53.150+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:53.639 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:53.634+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:54.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:54.114+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:54.664 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:54.658+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:55.075 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:55.070+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:55.703 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:55.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:56.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:56.054+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:56.740 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:56.734+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:57.077 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:57.070+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:57.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:57.778+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:58.059 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:58.054+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:58.780 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:58.774+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:02:58.915 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-08-23T04:02:58.916 INFO:tasks.ceph:Scrubbing osd.1 2023-08-23T04:02:58.916 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-08-23T04:02:59.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:02:59.082+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:02:59.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:02:59.826+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:00.061 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:00.054+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:00.829 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:00.822+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:01.087 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:01.082+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:01.802 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:01.794+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:02.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:02.082+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:02.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:02.826+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:03.052 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:03.046+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:03.813 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:03.806+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:04.053 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:04.046+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:04.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:04.770+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:05.094 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:05.086+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:05.771 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:05.766+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:06.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:06.134+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:06.785 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:06.778+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:07.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:07.170+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:07.753 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:07.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:08.134 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:08.126+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:08.723 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:08.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:09.122 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:09.114+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:09.748 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:09.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:10.108 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:10.102+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:10.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:10.790+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:11.152 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:11.146+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:11.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:11.826+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:12.127 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:12.122+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:12.880 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:12.874+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:13.088 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:13.082+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:13.867 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:13.862+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:14.105 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:14.098+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:14.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:14.890+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:15.146 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:15.138+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:15.939 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:15.933+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:16.173 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:16.165+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:16.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:16.889+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:17.189 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:17.181+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:17.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:17.901+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:18.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:18.205+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:18.950 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:18.941+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:19.251 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:19.245+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:19.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:19.981+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:20.221 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:20.213+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:20.951 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:20.945+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:21.213 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:21.205+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:21.911 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:21.905+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:22.250 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:22.241+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:22.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:22.881+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:23.284 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:23.277+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:23.901 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:23.897+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:24.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:24.245+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:24.909 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:24.901+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:25.217 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:25.209+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:25.926 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:25.917+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:26.176 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:26.169+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:26.916 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:26.913+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:27.220 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:27.217+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:27.874 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:27.869+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:28.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:28.249+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:28.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:28.913+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:29.213 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:29.205+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:29.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:29.897+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:30.165 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:30.161+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:30.919 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:30.917+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:31.208 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:31.205+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:31.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:31.949+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:32.225 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:32.221+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:32.969 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:32.965+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:33.227 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:33.225+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:33.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:33.961+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:34.254 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:34.249+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:34.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:34.913+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:35.249 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:35.245+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:35.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:35.889+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:36.241 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:36.237+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:36.886 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:36.881+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:37.211 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:37.209+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:37.921 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:37.917+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:38.184 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:38.181+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:38.956 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:38.953+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:39.148 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:39.145+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:39.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:39.989+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:40.139 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:40.137+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:41.005 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:41.001+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:41.103 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:41.097+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:42.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:42.009+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:42.139 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:42.137+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:43.042 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:43.041+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:43.131 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:43.129+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:44.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:43.997+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:44.119 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:44.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:45.035 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:45.033+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:45.098 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:45.093+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:46.021 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:46.017+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:46.109 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:46.105+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:47.069 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:47.065+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:47.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:47.069+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:48.050 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:48.045+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:48.098 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:48.093+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:49.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:49.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:49.131 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:49.129+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:50.046 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:50.041+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:50.109 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:50.105+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:51.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:51.001+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:51.138 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:51.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:51.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:51.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:52.169 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:52.165+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:52.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:52.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:53.172 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:53.169+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:53.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:53.929+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:54.200 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:54.197+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:54.939 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:54.937+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:55.154 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:55.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:55.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:55.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:56.135 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:56.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:56.908 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:56.905+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:57.159 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:57.157+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:57.881 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:57.877+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:58.124 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:58.121+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:58.846 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:58.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:03:59.077 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:03:59.073+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:03:59.896 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:03:59.893+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:00.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:00.037+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:00.937 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:00.933+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:01.082 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:01.077+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:01.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:01.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:02.057 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:02.053+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:02.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:02.941+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:03.101 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:03.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:03.896 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:03.893+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:04.079 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:04.077+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:04.895 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:04.893+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:05.119 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:05.117+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:05.931 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:05.929+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:06.138 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:06.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:06.977 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:06.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:07.121 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:07.117+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:07.977 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:07.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:08.103 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:08.101+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:09.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:08.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:09.088 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:09.085+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:10.021 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:10.017+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:10.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:10.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:11.012 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:11.009+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:11.075 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:11.073+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:11.968 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:11.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:12.070 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:12.065+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:12.991 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:12.985+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:13.062 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:13.057+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:13.952 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:13.949+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:14.026 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:14.021+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:14.970 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:14.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:15.059 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:15.057+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:16.011 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:16.009+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:16.019 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:16.017+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:17.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:16.997+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:17.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:17.053+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:18.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:18.009+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:18.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:18.069+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:19.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:19.001+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:19.120 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:19.117+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:19.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:19.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:20.087 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:20.081+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:21.005 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:21.001+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:21.057 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:21.053+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:21.979 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:21.977+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:22.039 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:22.037+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:23.013 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:23.009+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:23.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:23.029+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:23.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:23.993+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:24.005 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:24.001+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:24.983 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:24.981+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:25.025 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:25.021+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:25.967 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:25.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:25.985 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:25.981+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:26.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:26.949+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:27.006 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:27.001+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:27.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:27.953+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:27.989 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:27.985+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:28.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:28.929+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:29.001 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:28.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:29.966 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:29.961+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:30.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:30.013+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:30.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:30.961+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:30.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:30.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:31.988 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:31.985+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:31.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:31.993+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:32.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:32.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:33.042 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:33.037+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:33.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:33.933+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:34.052 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:34.049+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:34.921 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:34.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:35.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:35.013+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:35.909 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:35.905+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:35.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:35.985+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:36.909 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:36.905+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:36.946 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:36.941+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:37.944 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:37.941+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:37.953 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:37.949+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:38.902 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:38.897+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:38.973 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:38.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:39.898 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:39.893+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:40.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:40.009+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:40.935 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:40.933+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:41.052 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:41.049+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:41.928 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:41.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:42.010 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:42.005+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:42.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:42.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:42.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:42.997+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:43.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:43.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:43.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:43.965+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:44.931 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:44.929+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:44.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:44.929+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:45.947 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:45.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:45.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:45.957+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:46.917 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:46.913+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:46.960 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:46.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:47.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:47.897+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:47.959 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:47.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:48.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:48.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:48.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:48.933+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:49.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:49.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:49.981 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:49.977+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:50.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:50.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:51.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:51.021+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:51.964 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:51.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:52.010 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:52.005+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:52.952 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:52.949+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:53.060 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:53.057+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:53.952 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:53.949+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:54.103 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:54.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:54.965 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:54.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:55.102 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:55.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:56.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:55.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:56.054 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:56.049+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:57.022 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:57.017+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:57.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:57.025+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:58.007 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:58.005+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:58.039 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:58.033+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:58.936 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-08-23T04:04:58.938 INFO:tasks.ceph:Scrubbing osd.2 2023-08-23T04:04:58.938 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-08-23T04:04:58.962 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:58.957+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:04:59.051 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:04:59.049+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:04:59.085 INFO:teuthology.orchestra.run.smithi012.stdout:{ 2023-08-23T04:04:59.086 INFO:teuthology.orchestra.run.smithi012.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-23T04:04:59.086 INFO:teuthology.orchestra.run.smithi012.stdout:} 2023-08-23T04:04:59.099 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-08-23T04:04:59.440 INFO:teuthology.orchestra.run.smithi012.stderr:instructed osd(s) 2 to deep-scrub 2023-08-23T04:04:59.450 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:04:59.725 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:04:59.728 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:04:59.740 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5770,"stamp":"2023-08-23T04:04:58.981826+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":29991,"ondisk_log_size":29991,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1391112,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":903936,"kb_avail":281724408,"statfs":{"total":289910292480,"available":288485793792,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":925630464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003333"},"pg_stats":[{"pgid":"2.7","version":"157'1339","reported_seq":2237,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374849+0000","last_change":"2023-08-23T01:03:37.985948+0000","last_active":"2023-08-23T02:01:57.374849+0000","last_peered":"2023-08-23T02:01:57.374849+0000","last_clean":"2023-08-23T02:01:57.374849+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T02:01:57.374849+0000","last_undegraded":"2023-08-23T02:01:57.374849+0000","last_fullsized":"2023-08-23T02:01:57.374849+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"157'1472","reported_seq":2396,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374529+0000","last_change":"2023-08-23T01:03:37.986170+0000","last_active":"2023-08-23T02:01:57.374529+0000","last_peered":"2023-08-23T02:01:57.374529+0000","last_clean":"2023-08-23T02:01:57.374529+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T02:01:57.374529+0000","last_undegraded":"2023-08-23T02:01:57.374529+0000","last_fullsized":"2023-08-23T02:01:57.374529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1472,"ondisk_log_size":1472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"157'1112","reported_seq":2005,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374427+0000","last_change":"2023-08-23T01:03:37.985688+0000","last_active":"2023-08-23T02:01:57.374427+0000","last_peered":"2023-08-23T02:01:57.374427+0000","last_clean":"2023-08-23T02:01:57.374427+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T02:01:57.374427+0000","last_undegraded":"2023-08-23T02:01:57.374427+0000","last_fullsized":"2023-08-23T02:01:57.374427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1112,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"157'1550","reported_seq":2403,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374610+0000","last_change":"2023-08-23T01:03:37.986313+0000","last_active":"2023-08-23T02:01:57.374610+0000","last_peered":"2023-08-23T02:01:57.374610+0000","last_clean":"2023-08-23T02:01:57.374610+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T02:01:57.374610+0000","last_undegraded":"2023-08-23T02:01:57.374610+0000","last_fullsized":"2023-08-23T02:01:57.374610+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1550,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"157'5767","reported_seq":13084,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374695+0000","last_change":"2023-08-23T01:03:37.980433+0000","last_active":"2023-08-23T02:01:57.374695+0000","last_peered":"2023-08-23T02:01:57.374695+0000","last_clean":"2023-08-23T02:01:57.374695+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T02:01:57.374695+0000","last_undegraded":"2023-08-23T02:01:57.374695+0000","last_fullsized":"2023-08-23T02:01:57.374695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":5767,"ondisk_log_size":5767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"157'1464","reported_seq":2423,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374346+0000","last_change":"2023-08-23T01:03:37.980228+0000","last_active":"2023-08-23T02:01:57.374346+0000","last_peered":"2023-08-23T02:01:57.374346+0000","last_clean":"2023-08-23T02:01:57.374346+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T02:01:57.374346+0000","last_undegraded":"2023-08-23T02:01:57.374346+0000","last_fullsized":"2023-08-23T02:01:57.374346+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1464,"ondisk_log_size":1464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"157'4889","reported_seq":11141,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373392+0000","last_change":"2023-08-23T01:03:37.990362+0000","last_active":"2023-08-23T02:01:57.373392+0000","last_peered":"2023-08-23T02:01:57.373392+0000","last_clean":"2023-08-23T02:01:57.373392+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T02:01:57.373392+0000","last_undegraded":"2023-08-23T02:01:57.373392+0000","last_fullsized":"2023-08-23T02:01:57.373392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4889,"ondisk_log_size":4889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"157'1129","reported_seq":2092,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373425+0000","last_change":"2023-08-23T01:03:37.988894+0000","last_active":"2023-08-23T02:01:57.373425+0000","last_peered":"2023-08-23T02:01:57.373425+0000","last_clean":"2023-08-23T02:01:57.373425+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T02:01:57.373425+0000","last_undegraded":"2023-08-23T02:01:57.373425+0000","last_fullsized":"2023-08-23T02:01:57.373425+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1129,"ondisk_log_size":1129,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"157'3244","reported_seq":8243,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374344+0000","last_change":"2023-08-23T01:03:37.981619+0000","last_active":"2023-08-23T02:01:57.374344+0000","last_peered":"2023-08-23T02:01:57.374344+0000","last_clean":"2023-08-23T02:01:57.374344+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T02:01:57.374344+0000","last_undegraded":"2023-08-23T02:01:57.374344+0000","last_fullsized":"2023-08-23T02:01:57.374344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":3244,"ondisk_log_size":3244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"157'1844","reported_seq":2748,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373122+0000","last_change":"2023-08-23T01:03:37.990558+0000","last_active":"2023-08-23T02:01:57.373122+0000","last_peered":"2023-08-23T02:01:57.373122+0000","last_clean":"2023-08-23T02:01:57.373122+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T02:01:57.373122+0000","last_undegraded":"2023-08-23T02:01:57.373122+0000","last_fullsized":"2023-08-23T02:01:57.373122+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1844,"ondisk_log_size":1844,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"157'1847","reported_seq":2910,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374325+0000","last_change":"2023-08-23T01:03:37.985526+0000","last_active":"2023-08-23T02:01:57.374325+0000","last_peered":"2023-08-23T02:01:57.374325+0000","last_clean":"2023-08-23T02:01:57.374325+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T02:01:57.374325+0000","last_undegraded":"2023-08-23T02:01:57.374325+0000","last_fullsized":"2023-08-23T02:01:57.374325+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1847,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373852+0000","last_change":"2023-08-23T00:57:55.042710+0000","last_active":"2023-08-23T02:01:57.373852+0000","last_peered":"2023-08-23T02:01:57.373852+0000","last_clean":"2023-08-23T02:01:57.373852+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T02:01:57.373852+0000","last_undegraded":"2023-08-23T02:01:57.373852+0000","last_fullsized":"2023-08-23T02:01:57.373852+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_clean_scrub_stamp":"2023-08-23T00:57:54.020645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18234,"ondisk_log_size":18234,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11757,"ondisk_log_size":11757,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740622,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451224,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93920616,"statfs":{"total":96636764160,"available":96174710784,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.442,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73299999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57599999999999996,"15min":0.57499999999999996},"min":{"1min":0.48599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.64800000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.63600000000000001}]},{"osd":1,"last update":"Wed Aug 23 04:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.503,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.623,"5min":0.72599999999999998,"15min":0.79200000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.58199999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.70399999999999996,"5min":0.78800000000000003,"15min":0.79400000000000004},"last":0.77500000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740619,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":502516,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93869324,"statfs":{"total":96636764160,"available":96122187776,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:04:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53000000000000003,"15min":0.54100000000000004},"min":{"1min":0.42799999999999999,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.72299999999999998,"5min":0.73499999999999999,"15min":0.79300000000000004},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.66700000000000004,"15min":0.67400000000000004},"min":{"1min":0.53900000000000003,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.73299999999999998,"5min":0.78200000000000003,"15min":0.84999999999999998},"last":0.65200000000000002}]},{"osd":2,"last update":"Wed Aug 23 04:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.44400000000000001},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.80800000000000005},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.623,"15min":0.61199999999999999},"min":{"1min":0.54700000000000004,"5min":0.50800000000000001,"15min":0.46899999999999997},"max":{"1min":0.752,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.57799999999999996}]}]},{"osd":0,"up_from":8,"seq":34359740618,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:04:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.42999999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.64500000000000002,"5min":0.69399999999999995,"15min":0.748},"last":0.495},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59199999999999997}]},{"osd":2,"last update":"Wed Aug 23 04:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.48099999999999998,"5min":0.46400000000000002,"15min":0.42399999999999999},"max":{"1min":0.76600000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67600000000000005,"15min":0.66700000000000004},"min":{"1min":0.56299999999999994,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":0.84799999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.61399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:04:59.744 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:04:59.745 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:04:59.745 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:04:59.745 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:04:59.746 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:04:59.746 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:04:59.746 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:04:59.746 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:04:59.747 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:04:59.747 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:04:59.747 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:04:59.748 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:04:59.748 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-23T00:57:54.020645+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=54, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:04:59.748 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:04:59.974 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:04:59.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:00.028 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:00.025+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:00.995 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:00.993+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:01.020 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:01.017+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:01.986 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:01.981+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:02.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:02.029+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:02.944 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:02.941+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:03.073 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:03.069+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:03.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:03.972+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:04.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:04.068+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:05.011 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:05.008+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:05.121 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:05.116+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:06.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:06.000+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:06.144 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:06.140+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:06.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:06.964+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:07.116 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:07.112+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:07.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:07.928+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:08.101 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:08.096+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:08.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:08.884+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:09.064 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:09.060+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:09.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:09.848+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:10.044 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:10.040+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:10.854 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:10.848+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:11.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:11.020+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:11.859 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:11.856+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:12.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:12.044+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:12.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:12.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:13.008 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:13.004+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:13.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:13.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:14.014 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:14.012+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:14.878 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:14.872+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:15.023 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:15.020+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:15.928 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:15.924+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:16.052 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:16.048+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:16.926 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:16.920+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:17.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:17.084+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:17.891 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:17.888+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:18.096 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:18.092+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:18.850 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:18.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:19.142 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:19.136+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:19.749 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:05:19.862 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:19.856+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:20.037 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:05:20.040 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:05:20.056 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5780,"stamp":"2023-08-23T04:05:18.987499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30048,"ondisk_log_size":30048,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1391112,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":903936,"kb_avail":281724408,"statfs":{"total":289910292480,"available":288485793792,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":925630464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003419"},"pg_stats":[{"pgid":"2.7","version":"157'1339","reported_seq":2237,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374849+0000","last_change":"2023-08-23T01:03:37.985948+0000","last_active":"2023-08-23T02:01:57.374849+0000","last_peered":"2023-08-23T02:01:57.374849+0000","last_clean":"2023-08-23T02:01:57.374849+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T02:01:57.374849+0000","last_undegraded":"2023-08-23T02:01:57.374849+0000","last_fullsized":"2023-08-23T02:01:57.374849+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"157'1472","reported_seq":2396,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374529+0000","last_change":"2023-08-23T01:03:37.986170+0000","last_active":"2023-08-23T02:01:57.374529+0000","last_peered":"2023-08-23T02:01:57.374529+0000","last_clean":"2023-08-23T02:01:57.374529+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T02:01:57.374529+0000","last_undegraded":"2023-08-23T02:01:57.374529+0000","last_fullsized":"2023-08-23T02:01:57.374529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1472,"ondisk_log_size":1472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"157'1112","reported_seq":2005,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374427+0000","last_change":"2023-08-23T01:03:37.985688+0000","last_active":"2023-08-23T02:01:57.374427+0000","last_peered":"2023-08-23T02:01:57.374427+0000","last_clean":"2023-08-23T02:01:57.374427+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T02:01:57.374427+0000","last_undegraded":"2023-08-23T02:01:57.374427+0000","last_fullsized":"2023-08-23T02:01:57.374427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1112,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"157'1550","reported_seq":2403,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374610+0000","last_change":"2023-08-23T01:03:37.986313+0000","last_active":"2023-08-23T02:01:57.374610+0000","last_peered":"2023-08-23T02:01:57.374610+0000","last_clean":"2023-08-23T02:01:57.374610+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T02:01:57.374610+0000","last_undegraded":"2023-08-23T02:01:57.374610+0000","last_fullsized":"2023-08-23T02:01:57.374610+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1550,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"157'5767","reported_seq":13084,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374695+0000","last_change":"2023-08-23T01:03:37.980433+0000","last_active":"2023-08-23T02:01:57.374695+0000","last_peered":"2023-08-23T02:01:57.374695+0000","last_clean":"2023-08-23T02:01:57.374695+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T02:01:57.374695+0000","last_undegraded":"2023-08-23T02:01:57.374695+0000","last_fullsized":"2023-08-23T02:01:57.374695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":5767,"ondisk_log_size":5767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"157'1464","reported_seq":2423,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374346+0000","last_change":"2023-08-23T01:03:37.980228+0000","last_active":"2023-08-23T02:01:57.374346+0000","last_peered":"2023-08-23T02:01:57.374346+0000","last_clean":"2023-08-23T02:01:57.374346+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T02:01:57.374346+0000","last_undegraded":"2023-08-23T02:01:57.374346+0000","last_fullsized":"2023-08-23T02:01:57.374346+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1464,"ondisk_log_size":1464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"157'4889","reported_seq":11141,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373392+0000","last_change":"2023-08-23T01:03:37.990362+0000","last_active":"2023-08-23T02:01:57.373392+0000","last_peered":"2023-08-23T02:01:57.373392+0000","last_clean":"2023-08-23T02:01:57.373392+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T02:01:57.373392+0000","last_undegraded":"2023-08-23T02:01:57.373392+0000","last_fullsized":"2023-08-23T02:01:57.373392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4889,"ondisk_log_size":4889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"157'3244","reported_seq":8243,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374344+0000","last_change":"2023-08-23T01:03:37.981619+0000","last_active":"2023-08-23T02:01:57.374344+0000","last_peered":"2023-08-23T02:01:57.374344+0000","last_clean":"2023-08-23T02:01:57.374344+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T02:01:57.374344+0000","last_undegraded":"2023-08-23T02:01:57.374344+0000","last_fullsized":"2023-08-23T02:01:57.374344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":3244,"ondisk_log_size":3244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"157'1847","reported_seq":2910,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374325+0000","last_change":"2023-08-23T01:03:37.985526+0000","last_active":"2023-08-23T02:01:57.374325+0000","last_peered":"2023-08-23T02:01:57.374325+0000","last_clean":"2023-08-23T02:01:57.374325+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T02:01:57.374325+0000","last_undegraded":"2023-08-23T02:01:57.374325+0000","last_fullsized":"2023-08-23T02:01:57.374325+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1847,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373852+0000","last_change":"2023-08-23T00:57:55.042710+0000","last_active":"2023-08-23T02:01:57.373852+0000","last_peered":"2023-08-23T02:01:57.373852+0000","last_clean":"2023-08-23T02:01:57.373852+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T02:01:57.373852+0000","last_undegraded":"2023-08-23T02:01:57.373852+0000","last_fullsized":"2023-08-23T02:01:57.373852+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_clean_scrub_stamp":"2023-08-23T00:57:54.020645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18234,"ondisk_log_size":18234,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11814,"ondisk_log_size":11814,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740626,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451224,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93920616,"statfs":{"total":96636764160,"available":96174710784,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53600000000000003,"15min":0.53100000000000003},"min":{"1min":0.442,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.73299999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57599999999999996,"15min":0.57499999999999996},"min":{"1min":0.48599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.64800000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.58399999999999996}]},{"osd":1,"last update":"Wed Aug 23 04:04:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.503,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.623,"5min":0.72599999999999998,"15min":0.79200000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.58199999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.70399999999999996,"5min":0.78800000000000003,"15min":0.79400000000000004},"last":0.66500000000000004}]}]},{"osd":1,"up_from":8,"seq":34359740623,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":502516,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93869324,"statfs":{"total":96636764160,"available":96122187776,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:05:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.41999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64500000000000002,"5min":0.73499999999999999,"15min":0.79300000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65900000000000003,"15min":0.67400000000000004},"min":{"1min":0.505,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.77100000000000002,"5min":0.77300000000000002,"15min":0.84999999999999998},"last":0.78300000000000003}]},{"osd":2,"last update":"Wed Aug 23 04:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.44400000000000001},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.80800000000000005},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.623,"15min":0.61199999999999999},"min":{"1min":0.54700000000000004,"5min":0.50800000000000001,"15min":0.46899999999999997},"max":{"1min":0.752,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.68899999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740622,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:04:20 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51100000000000001,"15min":0.51200000000000001},"min":{"1min":0.42999999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.64500000000000002,"5min":0.69399999999999995,"15min":0.748},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.35699999999999998},"max":{"1min":0.67000000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54500000000000004}]},{"osd":2,"last update":"Wed Aug 23 04:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.48099999999999998,"5min":0.46400000000000002,"15min":0.42399999999999999},"max":{"1min":0.76600000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67600000000000005,"15min":0.66700000000000004},"min":{"1min":0.56299999999999994,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":0.84799999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.73099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:05:20.058 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:20.059 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:20.059 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:20.059 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:20.060 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:20.060 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:20.061 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:20.061 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:20.061 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:20.062 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:20.062 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-23T00:57:54.020645+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=54, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:20.062 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:05:20.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:20.104+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:20.871 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:20.868+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:21.127 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:21.124+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:21.864 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:21.860+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:22.132 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:22.128+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:22.865 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:22.860+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:23.178 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:23.172+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:23.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:23.864+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:24.202 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:24.196+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:24.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:24.864+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:25.224 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:25.220+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:25.847 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:25.844+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:26.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:26.260+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:26.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:26.852+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:27.288 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:27.284+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:27.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:27.804+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:28.308 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:28.304+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:28.790 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:28.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:29.272 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:29.268+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:29.746 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:29.740+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:30.243 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:30.240+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:30.771 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:30.768+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:31.230 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:31.224+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:31.808 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:31.804+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:32.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:32.200+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:32.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:32.848+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:33.212 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:33.208+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:33.887 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:33.880+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:34.200 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:34.196+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:34.874 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:34.868+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:35.200 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:35.196+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:35.837 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:35.832+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:36.203 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:36.196+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:36.845 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:36.840+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:37.166 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:37.160+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:37.825 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:37.820+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:38.124 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:38.120+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:38.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:38.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:39.141 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:39.136+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:39.780 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:39.776+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:40.064 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:05:40.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:40.152+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:40.341 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:05:40.344 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:05:40.355 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5790,"stamp":"2023-08-23T04:05:38.992955+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30048,"ondisk_log_size":30048,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1391112,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":903936,"kb_avail":281724408,"statfs":{"total":289910292480,"available":288485793792,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":925630464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003303"},"pg_stats":[{"pgid":"2.7","version":"157'1339","reported_seq":2237,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374849+0000","last_change":"2023-08-23T01:03:37.985948+0000","last_active":"2023-08-23T02:01:57.374849+0000","last_peered":"2023-08-23T02:01:57.374849+0000","last_clean":"2023-08-23T02:01:57.374849+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T02:01:57.374849+0000","last_undegraded":"2023-08-23T02:01:57.374849+0000","last_fullsized":"2023-08-23T02:01:57.374849+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"157'1472","reported_seq":2396,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374529+0000","last_change":"2023-08-23T01:03:37.986170+0000","last_active":"2023-08-23T02:01:57.374529+0000","last_peered":"2023-08-23T02:01:57.374529+0000","last_clean":"2023-08-23T02:01:57.374529+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T02:01:57.374529+0000","last_undegraded":"2023-08-23T02:01:57.374529+0000","last_fullsized":"2023-08-23T02:01:57.374529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1472,"ondisk_log_size":1472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"157'1112","reported_seq":2005,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374427+0000","last_change":"2023-08-23T01:03:37.985688+0000","last_active":"2023-08-23T02:01:57.374427+0000","last_peered":"2023-08-23T02:01:57.374427+0000","last_clean":"2023-08-23T02:01:57.374427+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T02:01:57.374427+0000","last_undegraded":"2023-08-23T02:01:57.374427+0000","last_fullsized":"2023-08-23T02:01:57.374427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1112,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"157'1550","reported_seq":2403,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374610+0000","last_change":"2023-08-23T01:03:37.986313+0000","last_active":"2023-08-23T02:01:57.374610+0000","last_peered":"2023-08-23T02:01:57.374610+0000","last_clean":"2023-08-23T02:01:57.374610+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T02:01:57.374610+0000","last_undegraded":"2023-08-23T02:01:57.374610+0000","last_fullsized":"2023-08-23T02:01:57.374610+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1550,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"157'5767","reported_seq":13084,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374695+0000","last_change":"2023-08-23T01:03:37.980433+0000","last_active":"2023-08-23T02:01:57.374695+0000","last_peered":"2023-08-23T02:01:57.374695+0000","last_clean":"2023-08-23T02:01:57.374695+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T02:01:57.374695+0000","last_undegraded":"2023-08-23T02:01:57.374695+0000","last_fullsized":"2023-08-23T02:01:57.374695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":5767,"ondisk_log_size":5767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"157'1464","reported_seq":2423,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374346+0000","last_change":"2023-08-23T01:03:37.980228+0000","last_active":"2023-08-23T02:01:57.374346+0000","last_peered":"2023-08-23T02:01:57.374346+0000","last_clean":"2023-08-23T02:01:57.374346+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T02:01:57.374346+0000","last_undegraded":"2023-08-23T02:01:57.374346+0000","last_fullsized":"2023-08-23T02:01:57.374346+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1464,"ondisk_log_size":1464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"157'4889","reported_seq":11141,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373392+0000","last_change":"2023-08-23T01:03:37.990362+0000","last_active":"2023-08-23T02:01:57.373392+0000","last_peered":"2023-08-23T02:01:57.373392+0000","last_clean":"2023-08-23T02:01:57.373392+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T02:01:57.373392+0000","last_undegraded":"2023-08-23T02:01:57.373392+0000","last_fullsized":"2023-08-23T02:01:57.373392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4889,"ondisk_log_size":4889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"157'3244","reported_seq":8243,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374344+0000","last_change":"2023-08-23T01:03:37.981619+0000","last_active":"2023-08-23T02:01:57.374344+0000","last_peered":"2023-08-23T02:01:57.374344+0000","last_clean":"2023-08-23T02:01:57.374344+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T02:01:57.374344+0000","last_undegraded":"2023-08-23T02:01:57.374344+0000","last_fullsized":"2023-08-23T02:01:57.374344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":3244,"ondisk_log_size":3244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"157'1847","reported_seq":2910,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374325+0000","last_change":"2023-08-23T01:03:37.985526+0000","last_active":"2023-08-23T02:01:57.374325+0000","last_peered":"2023-08-23T02:01:57.374325+0000","last_clean":"2023-08-23T02:01:57.374325+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T02:01:57.374325+0000","last_undegraded":"2023-08-23T02:01:57.374325+0000","last_fullsized":"2023-08-23T02:01:57.374325+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1847,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373852+0000","last_change":"2023-08-23T00:57:55.042710+0000","last_active":"2023-08-23T02:01:57.373852+0000","last_peered":"2023-08-23T02:01:57.373852+0000","last_clean":"2023-08-23T02:01:57.373852+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T02:01:57.373852+0000","last_undegraded":"2023-08-23T02:01:57.373852+0000","last_fullsized":"2023-08-23T02:01:57.373852+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_clean_scrub_stamp":"2023-08-23T00:57:54.020645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18234,"ondisk_log_size":18234,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11814,"ondisk_log_size":11814,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740630,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451224,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93920616,"statfs":{"total":96636764160,"available":96174710784,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.64100000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.47599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.64800000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.56799999999999995}]},{"osd":1,"last update":"Wed Aug 23 04:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.52300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.79200000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66700000000000004,"15min":0.66200000000000003},"min":{"1min":0.59499999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.77500000000000002,"5min":0.78800000000000003,"15min":0.79400000000000004},"last":0.64400000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740627,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":502516,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93869324,"statfs":{"total":96636764160,"available":96122187776,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:05:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.41999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64500000000000002,"5min":0.73499999999999999,"15min":0.79300000000000004},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65900000000000003,"15min":0.67400000000000004},"min":{"1min":0.505,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.77100000000000002,"5min":0.77300000000000002,"15min":0.84999999999999998},"last":0.56899999999999995}]},{"osd":2,"last update":"Wed Aug 23 04:04:49 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57499999999999996,"15min":0.58699999999999997},"min":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.44400000000000001},"max":{"1min":0.79300000000000004,"5min":0.80700000000000005,"15min":0.80800000000000005},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.623,"15min":0.61199999999999999},"min":{"1min":0.54700000000000004,"5min":0.50800000000000001,"15min":0.46899999999999997},"max":{"1min":0.752,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.64700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740626,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.39400000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.748},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.48499999999999999,"5min":0.44,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Wed Aug 23 04:04:48 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.63200000000000001,"15min":0.63},"min":{"1min":0.48099999999999998,"5min":0.46400000000000002,"15min":0.42399999999999999},"max":{"1min":0.76600000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.626},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.67600000000000005,"15min":0.66700000000000004},"min":{"1min":0.56299999999999994,"5min":0.49099999999999999,"15min":0.46600000000000003},"max":{"1min":0.84799999999999998,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.69599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:05:40.357 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:40.357 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:40.357 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:40.358 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:40.358 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:40.358 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:40.359 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:40.359 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:40.359 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:40.360 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:40.360 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-23T00:57:54.020645+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=54, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:05:40.360 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:05:40.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:40.808+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:41.119 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:41.116+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:41.830 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:41.824+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:42.083 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:42.080+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:42.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:42.788+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:43.045 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:43.040+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:43.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:43.840+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:44.026 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:44.020+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:44.846 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:44.840+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:45.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:45.036+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:45.818 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:45.812+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:46.090 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:46.084+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:46.846 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:46.840+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:47.058 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:47.052+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:47.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:47.888+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:48.059 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:48.056+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:48.881 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:48.876+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:49.016 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:49.012+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:49.863 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:49.856+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:50.050 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:50.044+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:50.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:50.880+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:51.023 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:51.020+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:51.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:51.904+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:52.027 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:52.024+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:52.954 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:52.948+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:52.991 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:52.988+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:53.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:53.964+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:54.031 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:54.028+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:54.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:54.972+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:54.992 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:54.988+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:55.937 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:55.932+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:55.999 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:55.996+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:56.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:56.940+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:56.956 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:56.952+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:57.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:57.908+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:57.965 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:57.960+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:58.885 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:58.880+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:58.949 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:58.944+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:05:59.848 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:05:59.844+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:05:59.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:05:59.960+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:00.361 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:06:00.646 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:06:00.650 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:06:00.659 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5800,"stamp":"2023-08-23T04:05:58.998409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30048,"ondisk_log_size":30048,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1391112,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":903936,"kb_avail":281724408,"statfs":{"total":289910292480,"available":288485793792,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":925630464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003252"},"pg_stats":[{"pgid":"2.7","version":"157'1339","reported_seq":2237,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374849+0000","last_change":"2023-08-23T01:03:37.985948+0000","last_active":"2023-08-23T02:01:57.374849+0000","last_peered":"2023-08-23T02:01:57.374849+0000","last_clean":"2023-08-23T02:01:57.374849+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T02:01:57.374849+0000","last_undegraded":"2023-08-23T02:01:57.374849+0000","last_fullsized":"2023-08-23T02:01:57.374849+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"157'1472","reported_seq":2396,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374529+0000","last_change":"2023-08-23T01:03:37.986170+0000","last_active":"2023-08-23T02:01:57.374529+0000","last_peered":"2023-08-23T02:01:57.374529+0000","last_clean":"2023-08-23T02:01:57.374529+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T02:01:57.374529+0000","last_undegraded":"2023-08-23T02:01:57.374529+0000","last_fullsized":"2023-08-23T02:01:57.374529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1472,"ondisk_log_size":1472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"157'1112","reported_seq":2005,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374427+0000","last_change":"2023-08-23T01:03:37.985688+0000","last_active":"2023-08-23T02:01:57.374427+0000","last_peered":"2023-08-23T02:01:57.374427+0000","last_clean":"2023-08-23T02:01:57.374427+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T02:01:57.374427+0000","last_undegraded":"2023-08-23T02:01:57.374427+0000","last_fullsized":"2023-08-23T02:01:57.374427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1112,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"157'1550","reported_seq":2403,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374610+0000","last_change":"2023-08-23T01:03:37.986313+0000","last_active":"2023-08-23T02:01:57.374610+0000","last_peered":"2023-08-23T02:01:57.374610+0000","last_clean":"2023-08-23T02:01:57.374610+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T02:01:57.374610+0000","last_undegraded":"2023-08-23T02:01:57.374610+0000","last_fullsized":"2023-08-23T02:01:57.374610+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1550,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"157'5767","reported_seq":13084,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374695+0000","last_change":"2023-08-23T01:03:37.980433+0000","last_active":"2023-08-23T02:01:57.374695+0000","last_peered":"2023-08-23T02:01:57.374695+0000","last_clean":"2023-08-23T02:01:57.374695+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T02:01:57.374695+0000","last_undegraded":"2023-08-23T02:01:57.374695+0000","last_fullsized":"2023-08-23T02:01:57.374695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":5767,"ondisk_log_size":5767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"157'1464","reported_seq":2423,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374346+0000","last_change":"2023-08-23T01:03:37.980228+0000","last_active":"2023-08-23T02:01:57.374346+0000","last_peered":"2023-08-23T02:01:57.374346+0000","last_clean":"2023-08-23T02:01:57.374346+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T02:01:57.374346+0000","last_undegraded":"2023-08-23T02:01:57.374346+0000","last_fullsized":"2023-08-23T02:01:57.374346+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1464,"ondisk_log_size":1464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"157'4889","reported_seq":11141,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373392+0000","last_change":"2023-08-23T01:03:37.990362+0000","last_active":"2023-08-23T02:01:57.373392+0000","last_peered":"2023-08-23T02:01:57.373392+0000","last_clean":"2023-08-23T02:01:57.373392+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T02:01:57.373392+0000","last_undegraded":"2023-08-23T02:01:57.373392+0000","last_fullsized":"2023-08-23T02:01:57.373392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4889,"ondisk_log_size":4889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"157'3244","reported_seq":8243,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374344+0000","last_change":"2023-08-23T01:03:37.981619+0000","last_active":"2023-08-23T02:01:57.374344+0000","last_peered":"2023-08-23T02:01:57.374344+0000","last_clean":"2023-08-23T02:01:57.374344+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T02:01:57.374344+0000","last_undegraded":"2023-08-23T02:01:57.374344+0000","last_fullsized":"2023-08-23T02:01:57.374344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":3244,"ondisk_log_size":3244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"157'1847","reported_seq":2910,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374325+0000","last_change":"2023-08-23T01:03:37.985526+0000","last_active":"2023-08-23T02:01:57.374325+0000","last_peered":"2023-08-23T02:01:57.374325+0000","last_clean":"2023-08-23T02:01:57.374325+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T02:01:57.374325+0000","last_undegraded":"2023-08-23T02:01:57.374325+0000","last_fullsized":"2023-08-23T02:01:57.374325+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1847,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373852+0000","last_change":"2023-08-23T00:57:55.042710+0000","last_active":"2023-08-23T02:01:57.373852+0000","last_peered":"2023-08-23T02:01:57.373852+0000","last_clean":"2023-08-23T02:01:57.373852+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T02:01:57.373852+0000","last_undegraded":"2023-08-23T02:01:57.373852+0000","last_fullsized":"2023-08-23T02:01:57.373852+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_clean_scrub_stamp":"2023-08-23T00:57:54.020645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18234,"ondisk_log_size":18234,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11814,"ondisk_log_size":11814,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740634,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451224,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93920616,"statfs":{"total":96636764160,"available":96174710784,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.64100000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.504},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.47599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.64800000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.61799999999999999}]},{"osd":1,"last update":"Wed Aug 23 04:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.52300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.79200000000000004},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66700000000000004,"15min":0.66200000000000003},"min":{"1min":0.59499999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.77500000000000002,"5min":0.78800000000000003,"15min":0.79400000000000004},"last":0.77600000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740631,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":502516,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93869324,"statfs":{"total":96636764160,"available":96122187776,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:05:01 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.52700000000000002,"15min":0.53900000000000003},"min":{"1min":0.41999999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.64500000000000002,"5min":0.73499999999999999,"15min":0.79300000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65900000000000003,"15min":0.67400000000000004},"min":{"1min":0.505,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.77100000000000002,"5min":0.77300000000000002,"15min":0.84999999999999998},"last":0.74099999999999999}]},{"osd":2,"last update":"Wed Aug 23 04:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.44400000000000001},"max":{"1min":0.66600000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.73699999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.624}]}]},{"osd":0,"up_from":8,"seq":34359740630,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.39400000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.748},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.48499999999999999,"5min":0.44,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.60199999999999998}]},{"osd":2,"last update":"Wed Aug 23 04:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.62,"15min":0.63},"min":{"1min":0.47899999999999998,"5min":0.46400000000000002,"15min":0.42399999999999999},"max":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":1.4330000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.754,"5min":0.69199999999999995,"15min":0.67300000000000004},"min":{"1min":0.61099999999999999,"5min":0.49299999999999999,"15min":0.46600000000000003},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.64800000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:06:00.661 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:00.661 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:00.662 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:00.662 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:00.662 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:00.663 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:00.663 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:00.663 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:00.663 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:00.664 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:00.664 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-23T00:57:54.020645+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=54, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:00.664 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:06:00.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:00.824+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:00.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:00.988+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:01.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:01.808+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:02.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:02.008+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:02.778 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:02.772+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:03.033 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:03.028+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:03.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:03.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:03.999 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:03.996+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:04.838 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:04.832+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:05.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:05.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:05.852 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:05.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:05.973 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:05.968+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:06.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:06.820+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:06.983 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:06.980+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:07.809 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:07.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:07.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:07.992+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:08.768 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:08.764+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:09.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:09.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:09.760 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:09.756+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:10.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:10.040+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:10.738 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:10.732+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:11.082 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:11.076+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:11.698 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:11.692+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:12.042 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:12.036+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:12.671 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:12.668+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:13.023 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:13.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:13.692 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:13.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:14.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:14.016+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:14.736 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:14.732+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:15.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:15.016+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:15.721 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:15.716+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:15.978 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:15.972+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:16.714 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:16.708+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:17.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:17.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:17.747 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:17.744+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:17.989 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:17.984+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:18.743 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:18.740+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:19.040 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:19.036+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:19.698 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:19.692+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:20.010 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:20.004+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:20.665 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:06:20.672 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:20.668+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:20.963 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:06:20.966 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:06:20.975 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5810,"stamp":"2023-08-23T04:06:19.003741+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30048,"ondisk_log_size":30048,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1391112,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":903936,"kb_avail":281724408,"statfs":{"total":289910292480,"available":288485793792,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":925630464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003071"},"pg_stats":[{"pgid":"2.7","version":"157'1339","reported_seq":2237,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374849+0000","last_change":"2023-08-23T01:03:37.985948+0000","last_active":"2023-08-23T02:01:57.374849+0000","last_peered":"2023-08-23T02:01:57.374849+0000","last_clean":"2023-08-23T02:01:57.374849+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T02:01:57.374849+0000","last_undegraded":"2023-08-23T02:01:57.374849+0000","last_fullsized":"2023-08-23T02:01:57.374849+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"157'1472","reported_seq":2396,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374529+0000","last_change":"2023-08-23T01:03:37.986170+0000","last_active":"2023-08-23T02:01:57.374529+0000","last_peered":"2023-08-23T02:01:57.374529+0000","last_clean":"2023-08-23T02:01:57.374529+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T02:01:57.374529+0000","last_undegraded":"2023-08-23T02:01:57.374529+0000","last_fullsized":"2023-08-23T02:01:57.374529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1472,"ondisk_log_size":1472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"157'1112","reported_seq":2005,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374427+0000","last_change":"2023-08-23T01:03:37.985688+0000","last_active":"2023-08-23T02:01:57.374427+0000","last_peered":"2023-08-23T02:01:57.374427+0000","last_clean":"2023-08-23T02:01:57.374427+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T02:01:57.374427+0000","last_undegraded":"2023-08-23T02:01:57.374427+0000","last_fullsized":"2023-08-23T02:01:57.374427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1112,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"157'1550","reported_seq":2403,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374610+0000","last_change":"2023-08-23T01:03:37.986313+0000","last_active":"2023-08-23T02:01:57.374610+0000","last_peered":"2023-08-23T02:01:57.374610+0000","last_clean":"2023-08-23T02:01:57.374610+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T02:01:57.374610+0000","last_undegraded":"2023-08-23T02:01:57.374610+0000","last_fullsized":"2023-08-23T02:01:57.374610+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1550,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"157'5767","reported_seq":13084,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374695+0000","last_change":"2023-08-23T01:03:37.980433+0000","last_active":"2023-08-23T02:01:57.374695+0000","last_peered":"2023-08-23T02:01:57.374695+0000","last_clean":"2023-08-23T02:01:57.374695+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T02:01:57.374695+0000","last_undegraded":"2023-08-23T02:01:57.374695+0000","last_fullsized":"2023-08-23T02:01:57.374695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":5767,"ondisk_log_size":5767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"157'1464","reported_seq":2423,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374346+0000","last_change":"2023-08-23T01:03:37.980228+0000","last_active":"2023-08-23T02:01:57.374346+0000","last_peered":"2023-08-23T02:01:57.374346+0000","last_clean":"2023-08-23T02:01:57.374346+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T02:01:57.374346+0000","last_undegraded":"2023-08-23T02:01:57.374346+0000","last_fullsized":"2023-08-23T02:01:57.374346+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1464,"ondisk_log_size":1464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"157'4889","reported_seq":11141,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373392+0000","last_change":"2023-08-23T01:03:37.990362+0000","last_active":"2023-08-23T02:01:57.373392+0000","last_peered":"2023-08-23T02:01:57.373392+0000","last_clean":"2023-08-23T02:01:57.373392+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T02:01:57.373392+0000","last_undegraded":"2023-08-23T02:01:57.373392+0000","last_fullsized":"2023-08-23T02:01:57.373392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4889,"ondisk_log_size":4889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"157'3244","reported_seq":8243,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374344+0000","last_change":"2023-08-23T01:03:37.981619+0000","last_active":"2023-08-23T02:01:57.374344+0000","last_peered":"2023-08-23T02:01:57.374344+0000","last_clean":"2023-08-23T02:01:57.374344+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T02:01:57.374344+0000","last_undegraded":"2023-08-23T02:01:57.374344+0000","last_fullsized":"2023-08-23T02:01:57.374344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":3244,"ondisk_log_size":3244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"157'1847","reported_seq":2910,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374325+0000","last_change":"2023-08-23T01:03:37.985526+0000","last_active":"2023-08-23T02:01:57.374325+0000","last_peered":"2023-08-23T02:01:57.374325+0000","last_clean":"2023-08-23T02:01:57.374325+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T02:01:57.374325+0000","last_undegraded":"2023-08-23T02:01:57.374325+0000","last_fullsized":"2023-08-23T02:01:57.374325+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1847,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373852+0000","last_change":"2023-08-23T00:57:55.042710+0000","last_active":"2023-08-23T02:01:57.373852+0000","last_peered":"2023-08-23T02:01:57.373852+0000","last_clean":"2023-08-23T02:01:57.373852+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T02:01:57.373852+0000","last_undegraded":"2023-08-23T02:01:57.373852+0000","last_fullsized":"2023-08-23T02:01:57.373852+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_clean_scrub_stamp":"2023-08-23T00:57:54.020645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18234,"ondisk_log_size":18234,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11814,"ondisk_log_size":11814,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740638,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451224,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93920616,"statfs":{"total":96636764160,"available":96174710784,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.64100000000000001,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.47599999999999998,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.64800000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.505}]},{"osd":1,"last update":"Wed Aug 23 04:05:20 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57899999999999996,"15min":0.57399999999999995},"min":{"1min":0.52300000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.79200000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.66700000000000004,"15min":0.66200000000000003},"min":{"1min":0.59499999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.77500000000000002,"5min":0.78800000000000003,"15min":0.79400000000000004},"last":0.61399999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740636,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":502516,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93869324,"statfs":{"total":96636764160,"available":96122187776,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.45000000000000001,"5min":0.41399999999999998,"15min":0.34899999999999998},"max":{"1min":0.71899999999999997,"5min":0.73499999999999999,"15min":0.79300000000000004},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.67500000000000004},"min":{"1min":0.56899999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.84999999999999998},"last":0.60899999999999999}]},{"osd":2,"last update":"Wed Aug 23 04:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.44400000000000001},"max":{"1min":0.66600000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.73699999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.71299999999999997}]}]},{"osd":0,"up_from":8,"seq":34359740634,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:05:21 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.45200000000000001,"5min":0.40400000000000003,"15min":0.39400000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.748},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.48499999999999999,"5min":0.44,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.45800000000000002}]},{"osd":2,"last update":"Wed Aug 23 04:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.62,"15min":0.63},"min":{"1min":0.47899999999999998,"5min":0.46400000000000002,"15min":0.42399999999999999},"max":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":1.4330000000000001},"last":0.5},{"interface":"front","average":{"1min":0.754,"5min":0.69199999999999995,"15min":0.67300000000000004},"min":{"1min":0.61099999999999999,"5min":0.49299999999999999,"15min":0.46600000000000003},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.70499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:06:20.977 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:20.977 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:20.978 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:20.978 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:20.978 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:20.978 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:20.979 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:20.979 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:20.979 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:20.980 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:20.980 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-23T00:57:54.020645+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=54, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:20.980 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:06:21.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:21.040+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:21.644 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:21.640+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:22.054 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:22.048+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:22.679 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:22.672+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:23.046 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:23.040+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:23.679 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:23.672+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:24.089 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:24.084+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:24.724 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:24.720+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:25.066 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:25.060+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:25.735 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:25.732+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:26.034 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:26.028+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:26.702 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:26.696+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:27.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:27.008+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:27.747 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:27.740+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:28.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:28.056+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:28.710 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:28.704+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:29.103 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:29.100+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:29.715 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:29.712+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:30.133 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:30.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:30.701 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:30.696+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:31.154 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:31.148+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:31.676 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:31.672+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:32.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:32.160+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:32.645 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:32.640+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:33.142 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:33.136+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:33.631 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:33.628+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:34.143 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:34.140+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:34.676 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:34.672+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:35.174 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:35.168+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:35.647 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:35.644+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:36.134 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:36.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:36.614 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:36.608+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:37.122 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:37.116+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:37.573 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:37.568+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:38.100 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:38.096+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:38.556 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:38.552+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:39.079 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:39.076+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:39.530 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:39.524+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:40.094 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:40.088+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:40.577 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:40.572+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:40.981 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:06:41.053 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:41.048+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:41.275 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:06:41.278 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:06:41.289 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5821,"stamp":"2023-08-23T04:06:41.009524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30048,"ondisk_log_size":30048,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1391112,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":903936,"kb_avail":281724408,"statfs":{"total":289910292480,"available":288485793792,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":925630464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003136"},"pg_stats":[{"pgid":"2.7","version":"157'1339","reported_seq":2237,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374849+0000","last_change":"2023-08-23T01:03:37.985948+0000","last_active":"2023-08-23T02:01:57.374849+0000","last_peered":"2023-08-23T02:01:57.374849+0000","last_clean":"2023-08-23T02:01:57.374849+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T02:01:57.374849+0000","last_undegraded":"2023-08-23T02:01:57.374849+0000","last_fullsized":"2023-08-23T02:01:57.374849+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"157'1472","reported_seq":2396,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374529+0000","last_change":"2023-08-23T01:03:37.986170+0000","last_active":"2023-08-23T02:01:57.374529+0000","last_peered":"2023-08-23T02:01:57.374529+0000","last_clean":"2023-08-23T02:01:57.374529+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T02:01:57.374529+0000","last_undegraded":"2023-08-23T02:01:57.374529+0000","last_fullsized":"2023-08-23T02:01:57.374529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1472,"ondisk_log_size":1472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"157'1112","reported_seq":2005,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374427+0000","last_change":"2023-08-23T01:03:37.985688+0000","last_active":"2023-08-23T02:01:57.374427+0000","last_peered":"2023-08-23T02:01:57.374427+0000","last_clean":"2023-08-23T02:01:57.374427+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T02:01:57.374427+0000","last_undegraded":"2023-08-23T02:01:57.374427+0000","last_fullsized":"2023-08-23T02:01:57.374427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1112,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"157'1550","reported_seq":2403,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374610+0000","last_change":"2023-08-23T01:03:37.986313+0000","last_active":"2023-08-23T02:01:57.374610+0000","last_peered":"2023-08-23T02:01:57.374610+0000","last_clean":"2023-08-23T02:01:57.374610+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T02:01:57.374610+0000","last_undegraded":"2023-08-23T02:01:57.374610+0000","last_fullsized":"2023-08-23T02:01:57.374610+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1550,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"157'5767","reported_seq":13084,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374695+0000","last_change":"2023-08-23T01:03:37.980433+0000","last_active":"2023-08-23T02:01:57.374695+0000","last_peered":"2023-08-23T02:01:57.374695+0000","last_clean":"2023-08-23T02:01:57.374695+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T02:01:57.374695+0000","last_undegraded":"2023-08-23T02:01:57.374695+0000","last_fullsized":"2023-08-23T02:01:57.374695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":5767,"ondisk_log_size":5767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"157'1464","reported_seq":2423,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374346+0000","last_change":"2023-08-23T01:03:37.980228+0000","last_active":"2023-08-23T02:01:57.374346+0000","last_peered":"2023-08-23T02:01:57.374346+0000","last_clean":"2023-08-23T02:01:57.374346+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T02:01:57.374346+0000","last_undegraded":"2023-08-23T02:01:57.374346+0000","last_fullsized":"2023-08-23T02:01:57.374346+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1464,"ondisk_log_size":1464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"157'4889","reported_seq":11141,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373392+0000","last_change":"2023-08-23T01:03:37.990362+0000","last_active":"2023-08-23T02:01:57.373392+0000","last_peered":"2023-08-23T02:01:57.373392+0000","last_clean":"2023-08-23T02:01:57.373392+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T02:01:57.373392+0000","last_undegraded":"2023-08-23T02:01:57.373392+0000","last_fullsized":"2023-08-23T02:01:57.373392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4889,"ondisk_log_size":4889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"157'3244","reported_seq":8243,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374344+0000","last_change":"2023-08-23T01:03:37.981619+0000","last_active":"2023-08-23T02:01:57.374344+0000","last_peered":"2023-08-23T02:01:57.374344+0000","last_clean":"2023-08-23T02:01:57.374344+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T02:01:57.374344+0000","last_undegraded":"2023-08-23T02:01:57.374344+0000","last_fullsized":"2023-08-23T02:01:57.374344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":3244,"ondisk_log_size":3244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"157'1847","reported_seq":2910,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374325+0000","last_change":"2023-08-23T01:03:37.985526+0000","last_active":"2023-08-23T02:01:57.374325+0000","last_peered":"2023-08-23T02:01:57.374325+0000","last_clean":"2023-08-23T02:01:57.374325+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T02:01:57.374325+0000","last_undegraded":"2023-08-23T02:01:57.374325+0000","last_fullsized":"2023-08-23T02:01:57.374325+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1847,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373852+0000","last_change":"2023-08-23T00:57:55.042710+0000","last_active":"2023-08-23T02:01:57.373852+0000","last_peered":"2023-08-23T02:01:57.373852+0000","last_clean":"2023-08-23T02:01:57.373852+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T02:01:57.373852+0000","last_undegraded":"2023-08-23T02:01:57.373852+0000","last_fullsized":"2023-08-23T02:01:57.373852+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_clean_scrub_stamp":"2023-08-23T00:57:54.020645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18234,"ondisk_log_size":18234,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11814,"ondisk_log_size":11814,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740642,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451224,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93920616,"statfs":{"total":96636764160,"available":96174710784,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.40300000000000002},"max":{"1min":0.64400000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.505,"5min":0.47599999999999998,"15min":0.42599999999999999},"max":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.77600000000000002},"last":0.55500000000000005}]},{"osd":1,"last update":"Wed Aug 23 04:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.503,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.65500000000000003,"5min":0.73699999999999999,"15min":0.79200000000000004},"last":0.626},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.57799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.72199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740640,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":502516,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93869324,"statfs":{"total":96636764160,"available":96122187776,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.45000000000000001,"5min":0.41399999999999998,"15min":0.34899999999999998},"max":{"1min":0.71899999999999997,"5min":0.73499999999999999,"15min":0.79300000000000004},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.67500000000000004},"min":{"1min":0.56899999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.84999999999999998},"last":0.67200000000000004}]},{"osd":2,"last update":"Wed Aug 23 04:05:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57499999999999996,"15min":0.58199999999999996},"min":{"1min":0.47399999999999998,"5min":0.46999999999999997,"15min":0.44400000000000001},"max":{"1min":0.66600000000000004,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.495},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.62,"15min":0.61299999999999999},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.73699999999999999,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56699999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740638,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39400000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.748},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.35699999999999998},"max":{"1min":0.66300000000000003,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed Aug 23 04:05:49 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.62,"15min":0.63},"min":{"1min":0.47899999999999998,"5min":0.46400000000000002,"15min":0.42399999999999999},"max":{"1min":0.75800000000000001,"5min":0.82599999999999996,"15min":1.4330000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.69199999999999995,"15min":0.67300000000000004},"min":{"1min":0.61099999999999999,"5min":0.49299999999999999,"15min":0.46600000000000003},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:06:41.291 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:41.291 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:41.292 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:41.292 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:41.292 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:41.293 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:41.293 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:41.293 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:41.294 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:41.294 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:41.294 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-23T00:57:54.020645+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=54, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:06:41.294 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:06:41.533 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:41.528+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:42.058 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:42.052+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:42.552 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:42.548+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:43.093 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:43.088+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:43.505 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:43.500+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:44.081 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:44.076+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:44.460 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:44.456+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:45.040 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:45.036+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:45.475 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:45.472+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:46.079 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:46.076+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:46.427 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:46.424+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:47.035 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:47.032+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:47.392 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:47.388+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:48.062 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:48.056+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:48.437 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:48.432+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:49.050 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:49.044+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:49.419 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:49.416+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:50.016 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:50.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:50.387 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:50.384+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:51.015 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:51.012+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:51.426 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:51.420+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:51.969 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:51.964+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:52.384 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:52.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:52.957 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:52.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:53.421 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:53.416+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:53.945 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:53.940+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:54.373 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:54.368+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:54.918 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:54.912+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:55.342 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:55.336+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:55.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:55.880+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:56.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:56.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:56.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:56.883+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:57.352 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:57.347+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:57.921 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:57.915+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:58.352 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:58.347+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:58.935 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:58.931+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:06:59.330 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:06:59.323+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:06:59.965 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:06:59.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:00.317 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:00.311+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:01.006 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:00.999+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:01.296 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:07:01.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:01.311+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:02.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:02.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:02.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:02.263+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:02.426 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:07:02.431 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:07:02.448 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5831,"stamp":"2023-08-23T04:07:01.014601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30048,"ondisk_log_size":30048,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1391112,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":903936,"kb_avail":281724408,"statfs":{"total":289910292480,"available":288485793792,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":925630464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003134"},"pg_stats":[{"pgid":"2.7","version":"157'1339","reported_seq":2237,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374849+0000","last_change":"2023-08-23T01:03:37.985948+0000","last_active":"2023-08-23T02:01:57.374849+0000","last_peered":"2023-08-23T02:01:57.374849+0000","last_clean":"2023-08-23T02:01:57.374849+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T02:01:57.374849+0000","last_undegraded":"2023-08-23T02:01:57.374849+0000","last_fullsized":"2023-08-23T02:01:57.374849+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"157'1472","reported_seq":2396,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374529+0000","last_change":"2023-08-23T01:03:37.986170+0000","last_active":"2023-08-23T02:01:57.374529+0000","last_peered":"2023-08-23T02:01:57.374529+0000","last_clean":"2023-08-23T02:01:57.374529+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T02:01:57.374529+0000","last_undegraded":"2023-08-23T02:01:57.374529+0000","last_fullsized":"2023-08-23T02:01:57.374529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1472,"ondisk_log_size":1472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"157'1112","reported_seq":2005,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374427+0000","last_change":"2023-08-23T01:03:37.985688+0000","last_active":"2023-08-23T02:01:57.374427+0000","last_peered":"2023-08-23T02:01:57.374427+0000","last_clean":"2023-08-23T02:01:57.374427+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T02:01:57.374427+0000","last_undegraded":"2023-08-23T02:01:57.374427+0000","last_fullsized":"2023-08-23T02:01:57.374427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1112,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"157'1550","reported_seq":2403,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374610+0000","last_change":"2023-08-23T01:03:37.986313+0000","last_active":"2023-08-23T02:01:57.374610+0000","last_peered":"2023-08-23T02:01:57.374610+0000","last_clean":"2023-08-23T02:01:57.374610+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T02:01:57.374610+0000","last_undegraded":"2023-08-23T02:01:57.374610+0000","last_fullsized":"2023-08-23T02:01:57.374610+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1550,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"157'5767","reported_seq":13084,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374695+0000","last_change":"2023-08-23T01:03:37.980433+0000","last_active":"2023-08-23T02:01:57.374695+0000","last_peered":"2023-08-23T02:01:57.374695+0000","last_clean":"2023-08-23T02:01:57.374695+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T02:01:57.374695+0000","last_undegraded":"2023-08-23T02:01:57.374695+0000","last_fullsized":"2023-08-23T02:01:57.374695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":5767,"ondisk_log_size":5767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"157'1464","reported_seq":2423,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374346+0000","last_change":"2023-08-23T01:03:37.980228+0000","last_active":"2023-08-23T02:01:57.374346+0000","last_peered":"2023-08-23T02:01:57.374346+0000","last_clean":"2023-08-23T02:01:57.374346+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T02:01:57.374346+0000","last_undegraded":"2023-08-23T02:01:57.374346+0000","last_fullsized":"2023-08-23T02:01:57.374346+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1464,"ondisk_log_size":1464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"157'4889","reported_seq":11141,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373392+0000","last_change":"2023-08-23T01:03:37.990362+0000","last_active":"2023-08-23T02:01:57.373392+0000","last_peered":"2023-08-23T02:01:57.373392+0000","last_clean":"2023-08-23T02:01:57.373392+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T02:01:57.373392+0000","last_undegraded":"2023-08-23T02:01:57.373392+0000","last_fullsized":"2023-08-23T02:01:57.373392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4889,"ondisk_log_size":4889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"157'3244","reported_seq":8243,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374344+0000","last_change":"2023-08-23T01:03:37.981619+0000","last_active":"2023-08-23T02:01:57.374344+0000","last_peered":"2023-08-23T02:01:57.374344+0000","last_clean":"2023-08-23T02:01:57.374344+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T02:01:57.374344+0000","last_undegraded":"2023-08-23T02:01:57.374344+0000","last_fullsized":"2023-08-23T02:01:57.374344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":3244,"ondisk_log_size":3244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"157'1847","reported_seq":2910,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374325+0000","last_change":"2023-08-23T01:03:37.985526+0000","last_active":"2023-08-23T02:01:57.374325+0000","last_peered":"2023-08-23T02:01:57.374325+0000","last_clean":"2023-08-23T02:01:57.374325+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T02:01:57.374325+0000","last_undegraded":"2023-08-23T02:01:57.374325+0000","last_fullsized":"2023-08-23T02:01:57.374325+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1847,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373852+0000","last_change":"2023-08-23T00:57:55.042710+0000","last_active":"2023-08-23T02:01:57.373852+0000","last_peered":"2023-08-23T02:01:57.373852+0000","last_clean":"2023-08-23T02:01:57.373852+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T02:01:57.373852+0000","last_undegraded":"2023-08-23T02:01:57.373852+0000","last_fullsized":"2023-08-23T02:01:57.373852+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_clean_scrub_stamp":"2023-08-23T00:57:54.020645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18234,"ondisk_log_size":18234,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11814,"ondisk_log_size":11814,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740646,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451224,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93920616,"statfs":{"total":96636764160,"available":96174710784,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.40300000000000002},"max":{"1min":0.64400000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.505,"5min":0.47599999999999998,"15min":0.42599999999999999},"max":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.77600000000000002},"last":0.56299999999999994}]},{"osd":1,"last update":"Wed Aug 23 04:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.503,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.65500000000000003,"5min":0.73699999999999999,"15min":0.79200000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.57799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.72099999999999997}]}]},{"osd":1,"up_from":8,"seq":34359740644,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":502516,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93869324,"statfs":{"total":96636764160,"available":96122187776,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.45000000000000001,"5min":0.41399999999999998,"15min":0.34899999999999998},"max":{"1min":0.71899999999999997,"5min":0.73499999999999999,"15min":0.79300000000000004},"last":0.498},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66800000000000004,"15min":0.67500000000000004},"min":{"1min":0.56899999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.84999999999999998},"last":0.74199999999999999}]},{"osd":2,"last update":"Wed Aug 23 04:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.44400000000000001},"max":{"1min":0.69099999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.61499999999999999},"min":{"1min":0.55000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":0.72199999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.53100000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740642,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39400000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.748},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.35699999999999998},"max":{"1min":0.66300000000000003,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Wed Aug 23 04:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.626},"min":{"1min":0.47599999999999998,"5min":0.46400000000000002,"15min":0.42399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69299999999999995,"15min":0.67400000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.76300000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.76500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:07:02.451 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:02.451 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:02.452 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:02.452 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:02.452 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:02.453 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:02.453 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:02.453 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:02.454 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:02.454 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:02.454 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-23T00:57:54.020645+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=54, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:02.454 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:07:03.046 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:03.039+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:03.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:03.263+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:04.024 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:04.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:04.245 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:04.239+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:05.019 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:05.015+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:05.282 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:05.275+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:06.007 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:06.003+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:06.324 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:06.319+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:07.040 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:07.035+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:07.337 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:07.331+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:08.010 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:08.003+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:08.314 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:08.307+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:09.001 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:08.995+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:09.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:09.311+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:09.998 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:09.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:10.348 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:10.343+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:11.050 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:11.043+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:11.362 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:11.355+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:12.076 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:12.071+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:12.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:12.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:13.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:13.039+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:13.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:13.431+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:14.030 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:14.023+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:14.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:14.427+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:14.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:14.983+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:15.474 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:15.467+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:15.980 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:15.975+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:16.444 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:16.439+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:16.960 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:16.955+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:17.487 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:17.483+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:17.990 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:17.987+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:18.499 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:18.495+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:18.975 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:18.971+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:19.532 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:19.527+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:19.946 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:19.939+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:20.511 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:20.507+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:20.973 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:20.967+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:21.480 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:21.475+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:22.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:22.007+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:22.435 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:22.431+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:22.455 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:07:22.755 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:07:22.757 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:07:22.774 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5841,"stamp":"2023-08-23T04:07:21.019963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30048,"ondisk_log_size":30048,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1391112,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":903936,"kb_avail":281724408,"statfs":{"total":289910292480,"available":288485793792,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":925630464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003225"},"pg_stats":[{"pgid":"2.7","version":"157'1339","reported_seq":2237,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374849+0000","last_change":"2023-08-23T01:03:37.985948+0000","last_active":"2023-08-23T02:01:57.374849+0000","last_peered":"2023-08-23T02:01:57.374849+0000","last_clean":"2023-08-23T02:01:57.374849+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T02:01:57.374849+0000","last_undegraded":"2023-08-23T02:01:57.374849+0000","last_fullsized":"2023-08-23T02:01:57.374849+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1339,"ondisk_log_size":1339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"157'1472","reported_seq":2396,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374529+0000","last_change":"2023-08-23T01:03:37.986170+0000","last_active":"2023-08-23T02:01:57.374529+0000","last_peered":"2023-08-23T02:01:57.374529+0000","last_clean":"2023-08-23T02:01:57.374529+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T02:01:57.374529+0000","last_undegraded":"2023-08-23T02:01:57.374529+0000","last_fullsized":"2023-08-23T02:01:57.374529+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1472,"ondisk_log_size":1472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"157'1112","reported_seq":2005,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374427+0000","last_change":"2023-08-23T01:03:37.985688+0000","last_active":"2023-08-23T02:01:57.374427+0000","last_peered":"2023-08-23T02:01:57.374427+0000","last_clean":"2023-08-23T02:01:57.374427+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T02:01:57.374427+0000","last_undegraded":"2023-08-23T02:01:57.374427+0000","last_fullsized":"2023-08-23T02:01:57.374427+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1112,"ondisk_log_size":1112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"157'1550","reported_seq":2403,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374610+0000","last_change":"2023-08-23T01:03:37.986313+0000","last_active":"2023-08-23T02:01:57.374610+0000","last_peered":"2023-08-23T02:01:57.374610+0000","last_clean":"2023-08-23T02:01:57.374610+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T02:01:57.374610+0000","last_undegraded":"2023-08-23T02:01:57.374610+0000","last_fullsized":"2023-08-23T02:01:57.374610+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1550,"ondisk_log_size":1550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"157'5767","reported_seq":13084,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374695+0000","last_change":"2023-08-23T01:03:37.980433+0000","last_active":"2023-08-23T02:01:57.374695+0000","last_peered":"2023-08-23T02:01:57.374695+0000","last_clean":"2023-08-23T02:01:57.374695+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T02:01:57.374695+0000","last_undegraded":"2023-08-23T02:01:57.374695+0000","last_fullsized":"2023-08-23T02:01:57.374695+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":5767,"ondisk_log_size":5767,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"157'1464","reported_seq":2423,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374346+0000","last_change":"2023-08-23T01:03:37.980228+0000","last_active":"2023-08-23T02:01:57.374346+0000","last_peered":"2023-08-23T02:01:57.374346+0000","last_clean":"2023-08-23T02:01:57.374346+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T02:01:57.374346+0000","last_undegraded":"2023-08-23T02:01:57.374346+0000","last_fullsized":"2023-08-23T02:01:57.374346+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1464,"ondisk_log_size":1464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"157'4889","reported_seq":11141,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373392+0000","last_change":"2023-08-23T01:03:37.990362+0000","last_active":"2023-08-23T02:01:57.373392+0000","last_peered":"2023-08-23T02:01:57.373392+0000","last_clean":"2023-08-23T02:01:57.373392+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T02:01:57.373392+0000","last_undegraded":"2023-08-23T02:01:57.373392+0000","last_fullsized":"2023-08-23T02:01:57.373392+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4889,"ondisk_log_size":4889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"157'3244","reported_seq":8243,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374344+0000","last_change":"2023-08-23T01:03:37.981619+0000","last_active":"2023-08-23T02:01:57.374344+0000","last_peered":"2023-08-23T02:01:57.374344+0000","last_clean":"2023-08-23T02:01:57.374344+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T02:01:57.374344+0000","last_undegraded":"2023-08-23T02:01:57.374344+0000","last_fullsized":"2023-08-23T02:01:57.374344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":3244,"ondisk_log_size":3244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"157'1847","reported_seq":2910,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.374325+0000","last_change":"2023-08-23T01:03:37.985526+0000","last_active":"2023-08-23T02:01:57.374325+0000","last_peered":"2023-08-23T02:01:57.374325+0000","last_clean":"2023-08-23T02:01:57.374325+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T02:01:57.374325+0000","last_undegraded":"2023-08-23T02:01:57.374325+0000","last_fullsized":"2023-08-23T02:01:57.374325+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:55.025179+0000","last_clean_scrub_stamp":"2023-08-23T00:57:55.025179+0000","log_size":1847,"ondisk_log_size":1847,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":157,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373852+0000","last_change":"2023-08-23T00:57:55.042710+0000","last_active":"2023-08-23T02:01:57.373852+0000","last_peered":"2023-08-23T02:01:57.373852+0000","last_clean":"2023-08-23T02:01:57.373852+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T02:01:57.373852+0000","last_undegraded":"2023-08-23T02:01:57.373852+0000","last_fullsized":"2023-08-23T02:01:57.373852+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:57:54.020645+0000","last_clean_scrub_stamp":"2023-08-23T00:57:54.020645+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18234,"ondisk_log_size":18234,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":75,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11814,"ondisk_log_size":11814,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740650,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":451224,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93920616,"statfs":{"total":96636764160,"available":96174710784,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.53400000000000003,"15min":0.52900000000000003},"min":{"1min":0.42399999999999999,"5min":0.41799999999999998,"15min":0.40300000000000002},"max":{"1min":0.64400000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.505,"5min":0.47599999999999998,"15min":0.42599999999999999},"max":{"1min":0.66500000000000004,"5min":0.71899999999999997,"15min":0.77600000000000002},"last":0.65000000000000002}]},{"osd":1,"last update":"Wed Aug 23 04:06:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.57799999999999996,"15min":0.57399999999999995},"min":{"1min":0.503,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.65500000000000003,"5min":0.73699999999999999,"15min":0.79200000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66700000000000004,"15min":0.66300000000000003},"min":{"1min":0.57799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.55300000000000005}]}]},{"osd":1,"up_from":8,"seq":34359740648,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":502516,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":297216,"kb_avail":93869324,"statfs":{"total":96636764160,"available":96122187776,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304349184},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68100000000000005,"5min":0.73499999999999999,"15min":0.78500000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.60899999999999999,"5min":0.48899999999999999,"15min":0.47399999999999998},"max":{"1min":0.80000000000000004,"5min":0.80200000000000005,"15min":0.84999999999999998},"last":0.56200000000000006}]},{"osd":2,"last update":"Wed Aug 23 04:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.44400000000000001},"max":{"1min":0.69099999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.61499999999999999},"min":{"1min":0.55000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":0.72199999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.622}]}]},{"osd":0,"up_from":8,"seq":34359740646,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:06:22 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.52100000000000002,"15min":0.51500000000000001},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39400000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.748},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.57099999999999995},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.35699999999999998},"max":{"1min":0.66300000000000003,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.432}]},{"osd":2,"last update":"Wed Aug 23 04:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.626},"min":{"1min":0.47599999999999998,"5min":0.46400000000000002,"15min":0.42399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69299999999999995,"15min":0.67400000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.76300000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.66200000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:07:22.775 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:22.776 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:22.776 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:22.777 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:22.777 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:22.777 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:22.777 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:22.778 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:22.778 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:22.779 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-08-23T00:57:55.025179+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=55, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:22.779 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-23T00:57:54.020645+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=57, tm_sec=54, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:22.779 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.7 2023-08-23T04:07:22.993 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:22.987+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:23.060 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 2.7 on osd.1 to deep-scrub 2023-08-23T04:07:23.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.6 2023-08-23T04:07:23.349 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 2.6 on osd.1 to deep-scrub 2023-08-23T04:07:23.360 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.5 2023-08-23T04:07:23.450 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:23.443+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:23.640 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 2.5 on osd.1 to deep-scrub 2023-08-23T04:07:23.650 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.4 2023-08-23T04:07:23.931 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 2.4 on osd.1 to deep-scrub 2023-08-23T04:07:23.941 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.3 2023-08-23T04:07:24.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:24.007+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:24.221 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.3 on osd.0 to deep-scrub 2023-08-23T04:07:24.232 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.2 2023-08-23T04:07:24.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:24.399+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:24.505 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 2.2 on osd.0 to deep-scrub 2023-08-23T04:07:24.516 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-08-23T04:07:24.802 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-08-23T04:07:24.812 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.1 2023-08-23T04:07:25.036 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:25.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:25.094 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.1 on osd.0 to deep-scrub 2023-08-23T04:07:25.108 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-08-23T04:07:25.363 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:25.359+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:25.387 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-08-23T04:07:25.402 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 2.3 2023-08-23T04:07:25.674 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 2.3 on osd.1 to deep-scrub 2023-08-23T04:07:25.684 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 1.0 2023-08-23T04:07:25.963 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 1.0 on osd.1 to deep-scrub 2023-08-23T04:07:25.973 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:07:26.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:26.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:26.386 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:26.379+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:27.061 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:27.055+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:27.345 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:27.339+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:28.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:28.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:28.303 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:28.299+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:29.108 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:29.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:29.276 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:29.271+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:30.120 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:30.115+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:30.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:30.231+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:31.154 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:31.147+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:31.260 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:31.255+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:32.118 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:32.111+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:32.309 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:32.303+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:33.123 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:33.115+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:33.328 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:33.323+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:34.111 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:34.107+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:34.324 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:34.319+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:35.122 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:35.115+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:35.326 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:35.319+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:36.136 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:36.131+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:36.361 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:36.355+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:37.152 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:37.147+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:37.377 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:37.371+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:38.192 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:38.187+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:38.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:38.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:39.152 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:39.147+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:39.355 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:39.351+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:40.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:40.119+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:40.399 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:40.395+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:41.089 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:41.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:41.424 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:41.419+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:42.071 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:42.063+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:42.422 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:42.415+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:43.039 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:43.035+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:43.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:43.431+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:44.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:44.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:44.418 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:44.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:45.123 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:45.119+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:45.396 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:45.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:45.974 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:07:46.086 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:46.079+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:46.261 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:07:46.263 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:07:46.274 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5853,"stamp":"2023-08-23T04:07:45.026435+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1640,"num_omap_keys":163,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003303"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740655,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.64700000000000002,"5min":0.73299999999999998,"15min":1.0009999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.67400000000000004}]},{"osd":1,"last update":"Wed Aug 23 04:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.79200000000000004},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.52000000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.76800000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740653,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68100000000000005,"5min":0.73499999999999999,"15min":0.78500000000000003},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.60899999999999999,"5min":0.48899999999999999,"15min":0.47399999999999998},"max":{"1min":0.80000000000000004,"5min":0.80200000000000005,"15min":0.84999999999999998},"last":0.83599999999999997}]},{"osd":2,"last update":"Wed Aug 23 04:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.495,"5min":0.47399999999999998,"15min":0.44400000000000001},"max":{"1min":0.69099999999999995,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.625,"15min":0.61499999999999999},"min":{"1min":0.55000000000000004,"5min":0.443,"15min":0.443},"max":{"1min":0.72199999999999998,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.69499999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740651,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.42099999999999999,"5min":0.39800000000000002,"15min":0.39400000000000002},"max":{"1min":0.68200000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.35699999999999998},"max":{"1min":0.64500000000000002,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.42499999999999999}]},{"osd":2,"last update":"Wed Aug 23 04:06:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61599999999999999,"15min":0.626},"min":{"1min":0.47599999999999998,"5min":0.46400000000000002,"15min":0.42399999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.443},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.69299999999999995,"15min":0.67400000000000004},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.76300000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.57399999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:07:46.276 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:46.276 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:07:46.277 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:07:46.374 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:46.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:47.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:47.099+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:47.391 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:47.387+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:48.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:48.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:48.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:48.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:49.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:49.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:49.371 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:49.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:50.032 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:50.027+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:50.363 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:50.359+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:50.994 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:50.987+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:51.383 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:51.379+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:51.996 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:51.991+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:52.424 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:52.419+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:52.965 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:52.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:53.443 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:53.439+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:53.984 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:53.979+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:54.413 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:54.407+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:55.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:55.011+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:55.409 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:55.403+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:56.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:56.039+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:56.419 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:56.415+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:57.075 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:57.071+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:57.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:57.455+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:58.029 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:58.023+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:58.462 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:58.455+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:07:59.059 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:07:59.055+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:07:59.450 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:07:59.443+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:00.025 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:00.019+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:00.493 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:00.487+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:00.985 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:00.979+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:01.516 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:01.511+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:01.982 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:01.975+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:02.536 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:02.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:02.969 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:02.963+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:03.505 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:03.499+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:03.964 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:03.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:04.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:04.479+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:04.934 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:04.927+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:05.494 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:05.487+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:05.952 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:05.947+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:06.278 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:08:06.483 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:06.479+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:06.565 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:08:06.570 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:08:06.585 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5863,"stamp":"2023-08-23T04:08:05.031887+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003277"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740660,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.64700000000000002,"5min":0.73299999999999998,"15min":1.0009999999999999},"last":0.504},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.57699999999999996}]},{"osd":1,"last update":"Wed Aug 23 04:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.79200000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.52000000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.69999999999999996}]}]},{"osd":1,"up_from":8,"seq":34359740657,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:07:08 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.34899999999999998},"max":{"1min":0.68100000000000005,"5min":0.73499999999999999,"15min":0.78500000000000003},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.60899999999999999,"5min":0.48899999999999999,"15min":0.47399999999999998},"max":{"1min":0.80000000000000004,"5min":0.80200000000000005,"15min":0.84999999999999998},"last":0.76400000000000001}]},{"osd":2,"last update":"Wed Aug 23 04:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72599999999999998,"5min":0.79300000000000004,"15min":0.80700000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.61699999999999999},"min":{"1min":0.505,"5min":0.443,"15min":0.443},"max":{"1min":0.746,"5min":0.77200000000000002,"15min":0.82199999999999995},"last":0.63800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740655,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.42099999999999999,"5min":0.39800000000000002,"15min":0.39400000000000002},"max":{"1min":0.68200000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.35699999999999998},"max":{"1min":0.64500000000000002,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.51100000000000001}]},{"osd":2,"last update":"Wed Aug 23 04:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60099999999999998,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68999999999999995,"15min":0.67200000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.71599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:08:06.586 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:08:06.587 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:08:06.587 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:08:06.937 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:06.931+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:07.439 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:07.435+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:07.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:07.951+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:08.436 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:08.431+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:08.966 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:08.959+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:09.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:09.391+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:10.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:09.995+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:10.356 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:10.351+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:10.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:10.963+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:11.392 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:11.387+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:11.955 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:11.951+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:12.351 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:12.347+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:12.981 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:12.975+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:13.382 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:13.375+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:13.994 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:13.987+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:14.355 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:14.351+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:15.008 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:15.003+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:15.373 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:15.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:15.970 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:15.963+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:16.410 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:16.403+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:16.932 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:16.927+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:17.450 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:17.443+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:17.956 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:17.951+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:18.407 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:18.403+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:18.977 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:18.971+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:19.422 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:19.415+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:20.012 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:20.007+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:20.425 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:20.419+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:21.031 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:21.027+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:21.457 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:21.451+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:22.067 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:22.063+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:22.432 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:22.427+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:23.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:23.031+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:23.444 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:23.439+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:24.087 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:24.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:24.423 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:24.419+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:25.089 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:25.083+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:25.459 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:25.455+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:26.111 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:26.107+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:26.454 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:26.447+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:26.588 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:08:26.879 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:08:26.882 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:08:26.893 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5873,"stamp":"2023-08-23T04:08:25.037504+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003380"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740664,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.64700000000000002,"5min":0.73299999999999998,"15min":1.0009999999999999},"last":0.505},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57199999999999995,"15min":0.57399999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.58599999999999997}]},{"osd":1,"last update":"Wed Aug 23 04:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.45700000000000002},"max":{"1min":0.70899999999999996,"5min":0.73699999999999999,"15min":0.79200000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.66900000000000004,"15min":0.66500000000000004},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.52000000000000002},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.78100000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740661,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.751},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84999999999999998},"last":0.82799999999999996}]},{"osd":2,"last update":"Wed Aug 23 04:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72599999999999998,"5min":0.79300000000000004,"15min":0.80700000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.61699999999999999},"min":{"1min":0.505,"5min":0.443,"15min":0.443},"max":{"1min":0.746,"5min":0.77200000000000002,"15min":0.82199999999999995},"last":0.73399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740659,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:07:24 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.42099999999999999,"5min":0.39800000000000002,"15min":0.39400000000000002},"max":{"1min":0.68200000000000005,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56499999999999995,"15min":0.56799999999999995},"min":{"1min":0.432,"5min":0.432,"15min":0.35699999999999998},"max":{"1min":0.64500000000000002,"5min":0.76700000000000002,"15min":0.88900000000000001},"last":0.63100000000000001}]},{"osd":2,"last update":"Wed Aug 23 04:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60099999999999998,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68999999999999995,"15min":0.67200000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:08:26.895 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:08:26.895 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:08:26.896 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:08:27.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:27.067+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:27.438 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:27.431+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:28.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:28.107+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:28.403 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:28.399+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:29.130 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:29.123+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:29.418 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:29.411+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:30.128 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:30.123+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:30.373 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:30.367+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:31.157 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:31.151+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:31.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:31.355+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:32.140 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:32.135+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:32.408 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:32.403+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:33.162 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:33.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:33.442 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:33.435+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:34.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:34.171+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:34.475 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:34.471+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:35.142 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:35.135+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:35.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:35.479+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:36.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:36.155+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:36.479 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:36.475+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:37.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:37.159+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:37.495 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:37.491+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:38.156 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:38.151+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:38.501 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:38.495+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:39.183 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:39.179+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:39.519 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:39.515+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:40.185 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:40.179+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:40.568 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:40.563+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:41.156 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:41.151+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:41.613 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:41.607+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:42.188 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:42.183+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:42.583 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:42.575+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:43.183 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:43.179+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:43.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:43.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:44.144 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:44.139+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:44.558 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:44.551+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:45.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:45.103+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:45.538 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:45.531+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:46.080 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:46.075+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:46.500 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:46.495+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:46.897 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:08:47.114 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:47.107+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:47.176 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:08:47.179 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:08:47.189 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5884,"stamp":"2023-08-23T04:08:47.043530+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003070"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740668,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.66200000000000003,"5min":0.73299999999999998,"15min":1.0009999999999999},"last":0.443},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57299999999999995,"15min":0.57599999999999996},"min":{"1min":0.502,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":0.67400000000000004,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.55200000000000005}]},{"osd":1,"last update":"Wed Aug 23 04:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.45700000000000002},"max":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.77600000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.57299999999999995,"5min":0.55300000000000005,"15min":0.52000000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.60299999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740665,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.751},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84999999999999998},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed Aug 23 04:07:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56599999999999995,"15min":0.57499999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.72599999999999998,"5min":0.79300000000000004,"15min":0.80700000000000005},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.622,"15min":0.61699999999999999},"min":{"1min":0.505,"5min":0.443,"15min":0.443},"max":{"1min":0.746,"5min":0.77200000000000002,"15min":0.82199999999999995},"last":0.63400000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740663,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.71799999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.52500000000000002}]},{"osd":2,"last update":"Wed Aug 23 04:07:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.60099999999999998,"15min":0.622},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.70099999999999996,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.68999999999999995,"15min":0.67200000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.72999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:08:47.191 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:08:47.192 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:08:47.192 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:08:47.522 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:47.515+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:48.106 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:48.099+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:48.488 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:48.482+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:49.071 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:49.066+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:49.440 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:49.434+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:50.034 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:50.026+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:50.468 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:50.462+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:51.053 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:51.046+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:51.454 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:51.446+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:52.033 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:52.026+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:52.486 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:52.478+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:53.064 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:53.058+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:53.507 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:53.502+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:54.063 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:54.058+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:54.541 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:54.534+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:55.074 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:55.066+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:55.539 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:55.534+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:56.047 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:56.042+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:56.502 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:56.494+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:57.089 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:57.082+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:57.523 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:57.518+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:58.049 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:58.042+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:58.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:58.542+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:08:59.043 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:08:59.038+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:08:59.593 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:08:59.586+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:00.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:00.086+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:00.585 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:00.578+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:01.099 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:01.094+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:01.560 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:01.554+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:02.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:02.086+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:02.577 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:02.570+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:03.111 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:03.106+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:03.579 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:03.574+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:04.086 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:04.078+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:04.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:04.590+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:05.046 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:05.038+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:05.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:05.582+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:06.083 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:06.074+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:06.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:06.558+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:07.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:07.098+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:07.193 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:09:07.486 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:09:07.489 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:09:07.501 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5894,"stamp":"2023-08-23T04:09:07.049041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003392"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740672,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.66200000000000003,"5min":0.73299999999999998,"15min":1.0009999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57299999999999995,"15min":0.57599999999999996},"min":{"1min":0.502,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":0.67400000000000004,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.54700000000000004}]},{"osd":1,"last update":"Wed Aug 23 04:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.45700000000000002},"max":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.77600000000000002},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.57299999999999995,"5min":0.55300000000000005,"15min":0.52000000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.58199999999999996}]}]},{"osd":1,"up_from":8,"seq":34359740669,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:08:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52800000000000002,"15min":0.53800000000000003},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.751},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.84999999999999998},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Aug 23 04:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.48299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75800000000000001,"5min":0.79300000000000004,"15min":0.80700000000000005},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.82199999999999995},"last":0.64000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740667,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.71799999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.58799999999999997}]},{"osd":2,"last update":"Wed Aug 23 04:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59999999999999998,"15min":0.62},"min":{"1min":0.46800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68000000000000005,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69299999999999995,"15min":0.67500000000000004},"min":{"1min":0.61299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81799999999999995,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.67300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:09:07.503 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:09:07.503 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:09:07.503 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:09:07.556 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:07.550+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:08.110 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:08.102+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:08.583 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:08.578+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:09.120 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:09.114+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:09.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:09.590+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:10.116 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:10.110+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:10.632 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:10.626+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:11.075 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:11.070+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:11.660 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:11.654+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:12.081 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:12.074+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:12.664 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:12.658+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:13.117 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:13.110+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:13.684 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:13.678+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:14.162 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:14.154+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:14.690 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:14.682+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:15.158 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:15.150+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:15.722 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:15.714+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:16.151 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:16.146+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:16.697 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:16.690+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:17.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:17.182+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:17.738 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:17.730+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:18.220 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:18.214+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:18.738 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:18.730+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:19.270 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:19.262+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:19.770 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:19.762+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:20.318 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:20.310+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:20.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:20.766+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:21.319 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:21.314+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:21.740 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:21.734+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:22.303 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:22.298+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:22.719 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:22.714+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:23.338 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:23.330+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:23.715 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:23.710+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:24.316 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:24.310+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:24.755 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:24.750+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:25.272 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:25.266+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:25.708 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:25.702+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:26.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:26.306+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:26.698 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:26.690+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:27.333 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:27.326+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:27.505 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:09:27.664 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:27.658+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:27.796 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:09:27.799 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:09:27.813 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5904,"stamp":"2023-08-23T04:09:27.054569+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003349"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740676,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.443,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.66200000000000003,"5min":0.73299999999999998,"15min":1.0009999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57299999999999995,"15min":0.57599999999999996},"min":{"1min":0.502,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":0.67400000000000004,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.58899999999999997}]},{"osd":1,"last update":"Wed Aug 23 04:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.45700000000000002},"max":{"1min":0.72099999999999997,"5min":0.73699999999999999,"15min":0.77600000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.57299999999999995,"5min":0.55300000000000005,"15min":0.52000000000000002},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64200000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740673,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.53600000000000003},"min":{"1min":0.41699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.67600000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.57999999999999996,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":0.83599999999999997,"15min":0.84999999999999998},"last":0.88300000000000001}]},{"osd":2,"last update":"Wed Aug 23 04:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.48299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75800000000000001,"5min":0.79300000000000004,"15min":0.80700000000000005},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.82199999999999995},"last":0.95999999999999996}]}]},{"osd":0,"up_from":8,"seq":34359740671,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:08:29 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.53200000000000003,"15min":0.51700000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.71799999999999997,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.56000000000000005,"15min":0.56499999999999995},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.56899999999999995}]},{"osd":2,"last update":"Wed Aug 23 04:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59999999999999998,"15min":0.62},"min":{"1min":0.46800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68000000000000005,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69299999999999995,"15min":0.67500000000000004},"min":{"1min":0.61299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81799999999999995,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.77600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:09:27.814 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:09:27.815 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:09:27.815 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:09:28.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:28.366+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:28.646 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:28.638+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:29.390 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:29.382+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:29.630 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:29.622+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:30.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:30.402+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:30.598 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:30.590+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:31.421 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:31.414+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:31.575 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:31.570+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:32.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:32.446+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:32.567 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:32.562+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:33.456 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:33.450+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:33.556 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:33.550+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:34.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:34.414+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:34.546 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:34.538+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:35.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:35.386+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:35.573 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:35.566+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:36.382 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:36.374+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:36.591 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:36.586+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:37.366 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:37.358+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:37.586 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:37.578+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:38.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:38.378+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:38.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:38.610+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:39.352 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:39.346+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:39.619 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:39.614+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:40.359 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:40.354+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:40.595 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:40.590+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:41.337 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:41.330+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:41.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:41.610+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:42.305 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:42.298+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:42.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:42.582+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:43.331 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:43.326+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:43.615 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:43.610+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:44.339 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:44.334+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:44.571 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:44.562+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:45.366 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:45.358+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:45.598 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:45.590+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:46.342 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:46.334+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:46.577 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:46.570+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:47.318 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:47.310+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:47.595 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:47.590+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:47.816 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:09:48.103 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:09:48.106 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:09:48.117 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5914,"stamp":"2023-08-23T04:09:47.059957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003267"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740680,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52600000000000002,"15min":0.52900000000000003},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.63500000000000001,"5min":0.66200000000000003,"15min":1.0009999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.501,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":0.69799999999999995,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.58799999999999997}]},{"osd":1,"last update":"Wed Aug 23 04:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77600000000000002},"last":0.62},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.52000000000000002},"max":{"1min":0.78100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.68799999999999994}]}]},{"osd":1,"up_from":8,"seq":34359740677,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.53600000000000003},"min":{"1min":0.41699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.67600000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.57999999999999996,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":0.83599999999999997,"15min":0.84999999999999998},"last":0.63800000000000001}]},{"osd":2,"last update":"Wed Aug 23 04:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.57499999999999996},"min":{"1min":0.48299999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.75800000000000001,"5min":0.79300000000000004,"15min":0.80700000000000005},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.621,"15min":0.61499999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.82199999999999995},"last":0.56000000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740675,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.42699999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.48599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65700000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.56399999999999995}]},{"osd":2,"last update":"Wed Aug 23 04:08:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.59999999999999998,"15min":0.62},"min":{"1min":0.46800000000000003,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.68000000000000005,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.69299999999999995,"15min":0.67500000000000004},"min":{"1min":0.61299999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81799999999999995,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.71499999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:09:48.119 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:09:48.119 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:09:48.120 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-08-23T04:09:48.365 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:48.358+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:48.407 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-08-23T04:09:48.418 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-08-23T04:09:48.554 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:48.546+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:48.693 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-08-23T04:09:48.703 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:09:49.365 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:49.358+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:49.597 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:49.590+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:50.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:50.378+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:50.561 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:50.554+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:51.377 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:51.370+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:51.552 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:51.546+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:52.366 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:52.358+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:52.567 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:52.562+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:53.327 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:53.322+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:53.536 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:53.530+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:54.357 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:54.350+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:54.547 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:54.542+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:55.336 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:55.330+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:55.576 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:55.570+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:56.372 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:56.366+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:56.581 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:56.574+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:57.380 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:57.374+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:57.577 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:57.570+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:58.339 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:58.334+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:58.606 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:58.598+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:09:59.379 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:09:59.374+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:09:59.617 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:09:59.610+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:00.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:00.354+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:00.656 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:00.650+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:01.315 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:01.310+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:01.676 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:01.670+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:02.332 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:02.326+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:02.667 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:02.662+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:03.287 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:03.282+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:03.676 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:03.670+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:04.319 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:04.314+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:04.669 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:04.662+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:05.285 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:05.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:05.669 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:05.662+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:06.246 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:06.238+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:06.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:06.618+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:07.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:07.226+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:07.590 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:07.582+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:08.252 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:08.246+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:08.555 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:08.550+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:08.705 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:10:08.995 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:10:08.998 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:10:09.007 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5924,"stamp":"2023-08-23T04:10:07.065297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003139"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740684,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52600000000000002,"15min":0.52900000000000003},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.63500000000000001,"5min":0.66200000000000003,"15min":1.0009999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.501,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":0.69799999999999995,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.56100000000000005}]},{"osd":1,"last update":"Wed Aug 23 04:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77600000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.52000000000000002},"max":{"1min":0.78100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.70399999999999996}]}]},{"osd":1,"up_from":8,"seq":34359740681,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:09:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.52600000000000002,"15min":0.53600000000000003},"min":{"1min":0.41699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.67600000000000005,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.57999999999999996,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.82799999999999996,"5min":0.83599999999999997,"15min":0.84999999999999998},"last":0.75800000000000001}]},{"osd":2,"last update":"Wed Aug 23 04:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.48899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.5,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740679,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.42699999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.48599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65700000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.55200000000000005}]},{"osd":2,"last update":"Wed Aug 23 04:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.61899999999999999},"min":{"1min":0.505,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75900000000000001,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.623},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69399999999999995,"15min":0.67900000000000005},"min":{"1min":0.51200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80000000000000004,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.67000000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:10:09.012 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:10:09.013 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:10:09.013 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:10:09.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:09.198+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:09.543 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:09.538+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:10.166 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:10.158+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:10.504 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:10.498+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:11.159 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:11.154+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:11.525 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:11.518+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:12.182 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:12.174+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:12.476 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:12.470+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:13.139 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:13.134+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:13.516 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:13.510+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:14.139 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:14.134+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:14.530 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:14.522+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:15.157 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:15.150+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:15.528 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:15.522+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:16.127 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:16.122+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:16.545 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:16.538+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:17.122 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:17.114+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:17.524 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:17.518+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:18.164 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:18.158+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:18.543 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:18.534+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:19.193 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:19.186+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:19.563 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:19.558+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:20.160 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:20.154+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:20.541 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:20.534+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:21.150 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:21.142+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:21.504 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:21.498+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:22.176 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:22.170+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:22.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:22.542+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:23.212 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:23.206+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:23.551 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:23.542+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:24.201 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:24.194+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:24.513 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:24.506+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:25.235 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:25.230+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:25.553 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:25.546+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:26.248 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:26.242+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:26.580 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:26.574+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:27.284 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:27.278+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:27.618 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:27.610+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:28.326 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:28.318+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:28.648 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:28.642+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:29.014 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:10:29.301 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:10:29.304 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:10:29.314 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5935,"stamp":"2023-08-23T04:10:29.071191+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003093"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740689,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52600000000000002,"15min":0.52900000000000003},"min":{"1min":0.442,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.63500000000000001,"5min":0.66200000000000003,"15min":1.0009999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57499999999999996},"min":{"1min":0.501,"5min":0.46700000000000003,"15min":0.42599999999999999},"max":{"1min":0.69799999999999995,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.52700000000000002}]},{"osd":1,"last update":"Wed Aug 23 04:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57999999999999996,"15min":0.57599999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77600000000000002},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.67100000000000004,"15min":0.66700000000000004},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.52000000000000002},"max":{"1min":0.78100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.621}]}]},{"osd":1,"up_from":8,"seq":34359740686,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.41599999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.72399999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68000000000000005,"15min":0.67700000000000005},"min":{"1min":0.55200000000000005,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.68500000000000005}]},{"osd":2,"last update":"Wed Aug 23 04:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.48899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.5,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.65000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740684,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:09:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.51700000000000002},"min":{"1min":0.42699999999999999,"5min":0.247,"15min":0.247},"max":{"1min":0.70599999999999996,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.48599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.65700000000000003,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.57399999999999995}]},{"osd":2,"last update":"Wed Aug 23 04:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.61899999999999999},"min":{"1min":0.505,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75900000000000001,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69399999999999995,"15min":0.67900000000000005},"min":{"1min":0.51200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80000000000000004,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.54800000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:10:29.315 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:10:29.316 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:10:29.316 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:10:29.317 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:29.310+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:29.638 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:29.630+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:30.296 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:30.290+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:30.645 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:30.638+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:31.296 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:31.290+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:31.597 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:31.590+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:32.266 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:32.258+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:32.593 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:32.586+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:33.228 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:33.222+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:33.612 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:33.606+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:34.223 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:34.218+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:34.658 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:34.650+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:35.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:35.182+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:35.698 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:35.690+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:36.169 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:36.162+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:36.722 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:36.714+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:37.210 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:37.202+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:37.745 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:37.738+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:38.254 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:38.246+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:38.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:38.778+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:39.248 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:39.242+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:39.783 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:39.778+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:40.282 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:40.274+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:40.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:40.790+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:41.261 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:41.254+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:41.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:41.806+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:42.262 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:42.254+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:42.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:42.778+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:43.281 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:43.274+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:43.833 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:43.825+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:44.288 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:44.281+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:44.830 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:44.821+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:45.267 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:45.261+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:45.830 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:45.821+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:46.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:46.233+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:46.879 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:46.873+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:47.271 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:47.265+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:47.862 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:47.853+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:48.275 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:48.269+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:48.820 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:48.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:49.228 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:49.221+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:49.317 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:10:49.605 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:10:49.607 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:10:49.621 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5945,"stamp":"2023-08-23T04:10:49.076620+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003114"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740693,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":1.0009999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.64000000000000001,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.62}]},{"osd":1,"last update":"Wed Aug 23 04:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.71599999999999997,"5min":0.77200000000000002,"15min":0.77600000000000002},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.79700000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.67800000000000005}]}]},{"osd":1,"up_from":8,"seq":34359740690,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.41599999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.72399999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68000000000000005,"15min":0.67700000000000005},"min":{"1min":0.55200000000000005,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.66700000000000004}]},{"osd":2,"last update":"Wed Aug 23 04:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.58199999999999996,"15min":0.57599999999999996},"min":{"1min":0.48899999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.62,"15min":0.61899999999999999},"min":{"1min":0.5,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.53300000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740688,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51900000000000002,"15min":0.51500000000000001},"min":{"1min":0.41699999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.629,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.48599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61699999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.56599999999999995}]},{"osd":2,"last update":"Wed Aug 23 04:09:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.59999999999999998,"15min":0.61899999999999999},"min":{"1min":0.505,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75900000000000001,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.69399999999999995,"15min":0.67900000000000005},"min":{"1min":0.51200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80000000000000004,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.52300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:10:49.623 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:10:49.623 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:10:49.624 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:10:49.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:49.833+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:50.269 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:50.261+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:50.802 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:50.793+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:51.239 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:51.233+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:51.833 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:51.825+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:52.238 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:52.229+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:52.867 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:52.861+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:53.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:53.197+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:53.859 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:53.853+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:54.207 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:54.201+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:54.860 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:54.853+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:55.240 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:55.233+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:55.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:55.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:56.197 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:56.193+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:56.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:56.833+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:57.226 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:57.221+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:57.866 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:57.861+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:58.237 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:58.233+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:58.864 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:58.857+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:10:59.243 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:10:59.237+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:10:59.825 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:10:59.821+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:00.198 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:00.193+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:00.778 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:00.773+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:01.222 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:01.217+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:01.752 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:01.749+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:02.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:02.173+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:02.770 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:02.765+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:03.215 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:03.213+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:03.728 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:03.725+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:04.183 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:04.181+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:04.712 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:04.709+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:05.137 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:05.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:05.758 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:05.753+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:06.137 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:06.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:06.764 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:06.761+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:07.172 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:07.169+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:07.814 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:07.809+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:08.167 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:08.165+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:08.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:08.793+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:09.132 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:09.129+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:09.625 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:11:09.795 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:09.793+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:09.917 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:11:09.919 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:11:09.929 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5955,"stamp":"2023-08-23T04:11:09.082440+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003250"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740697,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":1.0009999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.64000000000000001,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.58099999999999996}]},{"osd":1,"last update":"Wed Aug 23 04:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.71599999999999997,"5min":0.77200000000000002,"15min":0.77600000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.79700000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.61399999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740694,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:10:17 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52800000000000002,"15min":0.53400000000000003},"min":{"1min":0.41599999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.72399999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.68000000000000005,"15min":0.67700000000000005},"min":{"1min":0.55200000000000005,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.54100000000000004}]},{"osd":2,"last update":"Wed Aug 23 04:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59799999999999998,"15min":0.57899999999999996},"min":{"1min":0.52700000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81399999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.52800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.67600000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.69199999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740692,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51900000000000002,"15min":0.51500000000000001},"min":{"1min":0.41699999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.629,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.48599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61699999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.71899999999999997}]},{"osd":2,"last update":"Wed Aug 23 04:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.61599999999999999},"min":{"1min":0.51000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73599999999999999,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.52300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.748,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.77200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:11:09.931 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:11:09.932 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:11:09.932 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:11:10.158 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:10.153+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:10.761 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:10.757+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:11.117 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:11.113+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:11.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:11.769+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:12.139 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:12.137+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:12.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:12.817+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:13.164 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:13.161+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:13.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:13.845+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:14.141 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:14.137+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:14.872 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:14.869+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:15.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:15.185+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:15.848 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:15.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:16.171 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:16.169+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:16.863 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:16.861+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:17.161 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:17.157+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:17.821 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:17.817+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:18.138 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:18.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:18.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:18.817+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:19.168 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:19.165+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:19.797 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:19.793+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:20.207 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:20.205+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:20.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:20.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:21.216 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:21.213+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:21.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:21.837+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:22.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:22.237+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:22.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:22.873+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:23.194 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:23.189+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:23.923 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:23.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:24.155 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:24.153+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:24.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:24.933+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:25.112 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:25.109+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:25.922 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:25.917+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:26.148 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:26.145+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:26.933 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:26.929+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:27.136 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:27.133+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:27.949 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:27.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:28.095 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:28.089+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:28.994 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:28.989+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:29.126 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:29.121+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:29.933 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:11:29.950 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:29.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:30.133 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:30.129+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:30.223 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:11:30.225 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:11:30.235 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5965,"stamp":"2023-08-23T04:11:29.087990+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003238"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740701,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.41999999999999998,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":1.0009999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57099999999999995,"15min":0.57399999999999995},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.64000000000000001,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.53300000000000003}]},{"osd":1,"last update":"Wed Aug 23 04:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.71599999999999997,"5min":0.77200000000000002,"15min":0.77600000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.79700000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.57199999999999995}]}]},{"osd":1,"up_from":8,"seq":34359740698,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52300000000000002,"15min":0.53200000000000003},"min":{"1min":0.434,"5min":0.316,"15min":0.316},"max":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.54100000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76600000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.64700000000000002}]},{"osd":2,"last update":"Wed Aug 23 04:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59799999999999998,"15min":0.57899999999999996},"min":{"1min":0.52700000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81399999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.52800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.67600000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.67900000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740696,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:10:32 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51900000000000002,"15min":0.51500000000000001},"min":{"1min":0.41699999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.629,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55400000000000005,"15min":0.56200000000000006},"min":{"1min":0.48599999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.61699999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.59399999999999997}]},{"osd":2,"last update":"Wed Aug 23 04:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.61599999999999999},"min":{"1min":0.51000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73599999999999999,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.52300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.748,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.81799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:11:30.238 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:11:30.239 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:11:30.239 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:11:30.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:30.969+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:31.142 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:31.137+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:32.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:32.005+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:32.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:32.185+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:32.960 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:32.957+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:33.232 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:33.229+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:33.966 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:33.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:34.239 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:34.237+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:34.936 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:34.933+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:35.289 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:35.285+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:35.914 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:35.909+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:36.276 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:36.273+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:36.911 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:36.909+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:37.305 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:37.301+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:37.955 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:37.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:38.353 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:38.349+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:38.999 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:38.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:39.380 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:39.377+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:39.993 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:39.989+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:40.412 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:40.409+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:41.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:40.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:41.430 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:41.425+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:42.036 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:42.033+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:42.440 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:42.437+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:43.007 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:43.005+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:43.410 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:43.405+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:43.990 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:43.985+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:44.456 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:44.453+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:44.982 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:44.977+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:45.498 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:45.493+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:46.009 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:46.005+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:46.540 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:46.537+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:47.014 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:47.009+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:47.536 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:47.533+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:48.031 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:48.029+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:48.525 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:48.521+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:49.031 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:49.029+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:49.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:49.573+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:50.021 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:50.017+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:50.240 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:11:50.529 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:11:50.531 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:11:50.542 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5975,"stamp":"2023-08-23T04:11:49.093438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003239"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740705,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.64400000000000002,"5min":0.73399999999999999,"15min":1.0009999999999999},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.53100000000000003,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.64200000000000002,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.59199999999999997}]},{"osd":1,"last update":"Wed Aug 23 04:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.77600000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.53500000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.80500000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.55800000000000005}]}]},{"osd":1,"up_from":8,"seq":34359740702,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52300000000000002,"15min":0.53200000000000003},"min":{"1min":0.434,"5min":0.316,"15min":0.316},"max":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.54100000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76600000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.56299999999999994}]},{"osd":2,"last update":"Wed Aug 23 04:11:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.59799999999999998,"15min":0.57899999999999996},"min":{"1min":0.52700000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81399999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.52800000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.67600000000000005,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70799999999999996}]}]},{"osd":0,"up_from":8,"seq":34359740700,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.442,"5min":0.247,"15min":0.247},"max":{"1min":0.66500000000000004,"5min":0.71799999999999997,"15min":0.73399999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.49099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71899999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.74399999999999999}]},{"osd":2,"last update":"Wed Aug 23 04:11:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.61599999999999999},"min":{"1min":0.51000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73599999999999999,"5min":0.93100000000000005,"15min":1.4330000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67500000000000004,"15min":0.67800000000000005},"min":{"1min":0.52300000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.748,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:11:50.544 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:11:50.545 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:11:50.545 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-08-23T04:11:50.607 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:50.605+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:50.828 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-08-23T04:11:50.837 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-08-23T04:11:50.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:50.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:51.131 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-08-23T04:11:51.145 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:11:51.565 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:51.561+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:51.963 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:51.961+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:52.566 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:52.561+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:52.950 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:52.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:53.569 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:53.565+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:53.941 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:53.937+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:54.527 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:54.525+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:54.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:54.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:55.522 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:55.517+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:55.969 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:55.965+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:56.541 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:56.537+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:56.957 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:56.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:57.580 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:57.577+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:57.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:57.937+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:58.557 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:58.553+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:58.947 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:58.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:11:59.568 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:11:59.565+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:11:59.926 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:11:59.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:00.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:00.537+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:00.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:00.889+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:01.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:01.573+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:01.877 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:01.873+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:02.530 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:02.525+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:02.857 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:02.853+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:03.503 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:03.501+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:03.855 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:03.849+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:04.475 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:04.473+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:04.812 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:04.809+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:05.462 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:05.457+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:05.818 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:05.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:06.467 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:06.465+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:06.829 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:06.825+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:07.450 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:07.445+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:07.812 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:07.809+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:08.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:08.461+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:08.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:08.849+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:09.465 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:09.461+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:09.861 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:09.857+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:10.462 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:10.457+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:10.828 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:10.825+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:11.147 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:12:11.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:12:11.435 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:12:11.446 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5986,"stamp":"2023-08-23T04:12:11.099069+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003194"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740709,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.64400000000000002,"5min":0.73399999999999999,"15min":1.0009999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.53100000000000003,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.64200000000000002,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.56100000000000005}]},{"osd":1,"last update":"Wed Aug 23 04:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.77600000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.53500000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.80500000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.61799999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740706,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:11:17 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52300000000000002,"15min":0.53200000000000003},"min":{"1min":0.434,"5min":0.316,"15min":0.316},"max":{"1min":0.72899999999999998,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.501},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.54100000000000004,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.76600000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.64500000000000002}]},{"osd":2,"last update":"Wed Aug 23 04:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.58299999999999996},"min":{"1min":0.52100000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80600000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76400000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.60099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740704,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.442,"5min":0.247,"15min":0.247},"max":{"1min":0.66500000000000004,"5min":0.71799999999999997,"15min":0.73399999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.49099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71899999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.52600000000000002}]},{"osd":2,"last update":"Wed Aug 23 04:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.61399999999999999},"min":{"1min":0.48899999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":1.4330000000000001},"last":0.498},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.59799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.65900000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:12:11.448 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:12:11.448 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:12:11.448 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:12:11.485 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:11.481+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:11.806 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:11.801+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:12.496 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:12.493+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:12.801 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:12.797+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:13.457 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:13.453+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:13.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:13.801+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:14.501 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:14.497+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:14.837 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:14.833+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:15.504 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:15.501+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:15.808 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:15.805+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:16.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:16.553+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:16.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:16.793+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:17.569 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:17.565+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:17.818 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:17.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:18.563 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:18.561+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:18.829 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:18.825+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:19.598 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:19.593+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:19.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:19.781+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:20.577 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:20.573+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:20.821 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:20.817+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:21.543 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:21.541+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:21.772 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:21.769+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:22.532 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:22.529+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:22.772 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:22.769+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:23.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:23.537+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:23.820 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:23.817+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:24.501 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:24.497+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:24.830 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:24.825+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:25.494 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:25.489+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:25.864 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:25.861+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:26.458 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:26.453+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:26.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:26.889+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:27.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:27.465+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:27.917 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:27.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:28.489 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:28.485+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:28.952 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:28.949+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:29.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:29.461+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:29.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:29.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:30.422 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:30.417+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:30.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:30.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:31.449 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:12:31.458 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:31.453+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:31.741 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:12:31.744 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:12:31.754 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":5996,"stamp":"2023-08-23T04:12:31.104513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003311"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740713,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52800000000000002,"15min":0.52900000000000003},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.40300000000000002},"max":{"1min":0.64400000000000002,"5min":0.73399999999999999,"15min":1.0009999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57399999999999995,"15min":0.57499999999999996},"min":{"1min":0.53100000000000003,"5min":0.45400000000000001,"15min":0.42599999999999999},"max":{"1min":0.64200000000000002,"5min":0.74199999999999999,"15min":0.77600000000000002},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed Aug 23 04:11:35 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.57799999999999996,"15min":0.57699999999999996},"min":{"1min":0.46200000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.65800000000000003,"5min":0.77200000000000002,"15min":0.77600000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.53500000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.80500000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.65900000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740710,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80800000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.61399999999999999}]},{"osd":2,"last update":"Wed Aug 23 04:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.58299999999999996},"min":{"1min":0.52100000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80600000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.5},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76400000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.66200000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740708,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:11:32 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.442,"5min":0.247,"15min":0.247},"max":{"1min":0.66500000000000004,"5min":0.71799999999999997,"15min":0.73399999999999999},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55500000000000005,"15min":0.56299999999999994},"min":{"1min":0.49099999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71899999999999997,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.47999999999999998}]},{"osd":2,"last update":"Wed Aug 23 04:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.61399999999999999},"min":{"1min":0.48899999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":1.4330000000000001},"last":0.624},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.59799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:12:31.756 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:12:31.756 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:12:31.757 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:12:31.924 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:31.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:32.444 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:32.441+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:32.958 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:32.953+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:33.455 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:33.453+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:33.991 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:33.989+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:34.488 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:34.485+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:34.950 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:34.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:35.460 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:35.457+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:36.000 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:35.997+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:36.463 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:36.461+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:36.979 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:36.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:37.472 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:37.469+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:37.978 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:37.973+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:38.434 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:38.429+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:39.012 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:39.009+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:39.434 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:39.429+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:40.056 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:40.053+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:40.410 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:40.404+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:41.024 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:41.020+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:41.377 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:41.372+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:42.055 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:42.052+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:42.386 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:42.380+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:43.089 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:43.084+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:43.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:43.356+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:44.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:44.108+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:44.354 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:44.348+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:45.136 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:45.132+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:45.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:45.376+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:46.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:46.152+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:46.396 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:46.392+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:47.185 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:47.180+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:47.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:47.372+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:48.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:48.228+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:48.354 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:48.348+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:49.231 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:49.228+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:49.346 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:49.340+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:50.209 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:50.204+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:50.311 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:50.304+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:51.259 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:51.252+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:51.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:51.340+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:51.758 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:12:52.053 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:12:52.054 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:12:52.064 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6006,"stamp":"2023-08-23T04:12:51.109778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003226"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740717,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40300000000000002},"max":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":1.0009999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.77600000000000002},"last":0.56499999999999995}]},{"osd":1,"last update":"Wed Aug 23 04:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46999999999999997,"5min":0.436,"15min":0.436},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77600000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66300000000000003,"15min":0.66400000000000003},"min":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.75800000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.69099999999999995}]}]},{"osd":1,"up_from":8,"seq":34359740714,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80800000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.75600000000000001}]},{"osd":2,"last update":"Wed Aug 23 04:12:06 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.61099999999999999,"15min":0.58299999999999996},"min":{"1min":0.52100000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80600000000000005,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.61099999999999999,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76400000000000001,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61699999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740712,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.378,"5min":0.247,"15min":0.247},"max":{"1min":0.71299999999999997,"5min":0.71799999999999997,"15min":0.73399999999999999},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74399999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.54200000000000004}]},{"osd":2,"last update":"Wed Aug 23 04:12:01 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59299999999999997,"15min":0.61399999999999999},"min":{"1min":0.48899999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":1.4330000000000001},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.68200000000000005,"15min":0.68100000000000005},"min":{"1min":0.59799999999999998,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.57899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:12:52.067 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:12:52.068 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:12:52.069 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:12:52.286 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:52.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:52.307 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:52.304+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:53.270 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:53.264+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:53.292 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:53.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:54.262 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:54.256+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:54.288 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:54.284+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:55.226 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:55.220+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:55.254 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:55.248+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:56.255 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:56.252+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:56.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:56.256+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:57.241 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:57.236+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:57.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:57.264+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:58.217 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:58.212+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:58.253 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:58.248+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:12:59.234 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:12:59.228+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:12:59.251 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:12:59.248+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:00.247 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:00.244+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:00.264 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:00.260+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:01.229 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:01.224+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:01.268 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:01.264+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:02.240 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:02.236+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:02.305 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:02.300+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:03.216 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:03.212+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:03.316 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:03.312+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:04.263 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:04.256+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:04.338 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:04.332+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:05.252 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:05.248+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:05.293 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:05.288+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:06.271 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:06.264+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:06.342 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:06.336+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:07.289 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:07.284+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:07.370 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:07.364+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:08.247 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:08.244+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:08.352 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:08.348+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:09.234 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:09.228+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:09.368 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:09.364+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:10.262 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:10.256+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:10.362 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:10.356+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:11.285 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:11.280+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:11.390 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:11.384+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:12.070 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:13:12.270 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:12.264+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:12.355 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:13:12.359 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:13:12.365 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:12.360+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:12.368 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6016,"stamp":"2023-08-23T04:13:11.115100+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003308"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740721,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40300000000000002},"max":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":1.0009999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.77600000000000002},"last":0.58799999999999997}]},{"osd":1,"last update":"Wed Aug 23 04:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46999999999999997,"5min":0.436,"15min":0.436},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77600000000000002},"last":0.624},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66300000000000003,"15min":0.66400000000000003},"min":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.75800000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.71799999999999997}]}]},{"osd":1,"up_from":8,"seq":34359740718,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:12:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52400000000000002,"15min":0.53000000000000003},"min":{"1min":0.39600000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67200000000000004},"min":{"1min":0.52100000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.80800000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Wed Aug 23 04:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.58699999999999997},"min":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.72599999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.495,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.63900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740716,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.378,"5min":0.247,"15min":0.247},"max":{"1min":0.71299999999999997,"5min":0.71799999999999997,"15min":0.73399999999999999},"last":0.503},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74399999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.60799999999999998}]},{"osd":2,"last update":"Wed Aug 23 04:13:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.498,"5min":0.46800000000000003,"15min":0.41699999999999998},"max":{"1min":0.71899999999999997,"5min":0.76100000000000001,"15min":1.4330000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69499999999999995,"15min":0.68400000000000005},"min":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.69799999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:13:12.370 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:13:12.370 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:13:12.371 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:13:13.245 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:13.240+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:13.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:13.368+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:14.198 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:14.192+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:14.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:14.364+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:15.162 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:15.156+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:15.370 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:15.364+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:16.169 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:16.164+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:16.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:16.364+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:17.169 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:17.164+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:17.355 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:17.352+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:18.204 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:18.200+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:18.336 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:18.332+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:19.226 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:19.220+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:19.335 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:19.332+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:20.199 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:20.196+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:20.353 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:20.348+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:21.208 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:21.204+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:21.388 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:21.384+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:22.249 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:22.244+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:22.340 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:22.336+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:23.237 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:23.232+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:23.356 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:23.352+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:24.215 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:24.212+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:24.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:24.376+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:25.185 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:25.180+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:25.396 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:25.392+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:26.170 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:26.164+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:26.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:26.436+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:27.147 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:27.144+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:27.491 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:27.488+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:28.179 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:28.176+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:28.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:28.532+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:29.188 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:29.184+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:29.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:29.520+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:30.158 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:30.152+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:30.487 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:30.484+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:31.193 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:31.188+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:31.450 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:31.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:32.182 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:32.176+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:32.372 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:13:32.452 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:32.448+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:32.662 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:13:32.665 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:13:32.675 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6026,"stamp":"2023-08-23T04:13:31.120490+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003367"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740725,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.40300000000000002},"max":{"1min":0.73199999999999998,"5min":0.73399999999999999,"15min":1.0009999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57099999999999995,"15min":0.57299999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66900000000000004,"5min":0.69799999999999995,"15min":0.77600000000000002},"last":0.66200000000000003}]},{"osd":1,"last update":"Wed Aug 23 04:12:36 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.57399999999999995,"15min":0.57599999999999996},"min":{"1min":0.46999999999999997,"5min":0.436,"15min":0.436},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77600000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66300000000000003,"15min":0.66400000000000003},"min":{"1min":0.54700000000000004,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.75800000000000001,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.626}]}]},{"osd":1,"up_from":8,"seq":34359740722,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.316},"max":{"1min":0.74199999999999999,"5min":0.753,"15min":0.753},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66800000000000004,"15min":0.67100000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.79800000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.67300000000000004}]},{"osd":2,"last update":"Wed Aug 23 04:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.58699999999999997},"min":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.72599999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.625,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.495,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61799999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740720,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:12:33 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.51700000000000002,"15min":0.51800000000000002},"min":{"1min":0.378,"5min":0.247,"15min":0.247},"max":{"1min":0.71299999999999997,"5min":0.71799999999999997,"15min":0.73399999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55600000000000005,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.74399999999999999,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed Aug 23 04:13:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.498,"5min":0.46800000000000003,"15min":0.41699999999999998},"max":{"1min":0.71899999999999997,"5min":0.76100000000000001,"15min":1.4330000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69499999999999995,"15min":0.68400000000000005},"min":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:13:32.677 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:13:32.678 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:13:32.678 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:13:33.233 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:33.228+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:33.468 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:33.464+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:34.281 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:34.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:34.449 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:34.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:35.295 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:35.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:35.445 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:35.440+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:36.291 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:36.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:36.420 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:36.416+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:37.248 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:37.244+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:37.469 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:37.464+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:38.273 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:38.268+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:38.492 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:38.488+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:39.316 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:39.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:39.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:39.460+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:40.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:40.316+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:40.459 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:40.456+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:41.293 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:41.288+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:41.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:41.460+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:42.331 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:42.328+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:42.512 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:42.508+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:43.323 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:43.320+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:43.492 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:43.488+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:44.280 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:44.276+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:44.539 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:44.532+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:45.315 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:45.312+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:45.509 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:45.504+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:46.324 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:46.320+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:46.514 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:46.508+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:47.322 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:47.316+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:47.543 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:47.540+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:48.333 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:48.328+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:48.565 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:48.560+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:49.360 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:49.356+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:49.519 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:49.516+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:50.397 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:50.392+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:50.523 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:50.520+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:51.396 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:51.392+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:51.515 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:51.512+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:52.387 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:52.380+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:52.512 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:52.508+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:52.679 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:13:52.967 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:13:52.970 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:13:52.981 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6036,"stamp":"2023-08-23T04:13:51.125986+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003348"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740729,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.40300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0009999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.46100000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66200000000000003,"5min":0.69799999999999995,"15min":0.77600000000000002},"last":0.56899999999999995}]},{"osd":1,"last update":"Wed Aug 23 04:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57699999999999996,"15min":0.57599999999999996},"min":{"1min":0.51500000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.68400000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66200000000000003,"15min":0.66500000000000004},"min":{"1min":0.58199999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.754,"5min":0.80500000000000005,"15min":0.84199999999999997},"last":0.61699999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740726,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.316},"max":{"1min":0.74199999999999999,"5min":0.753,"15min":0.753},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66800000000000004,"15min":0.67100000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.79800000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.73899999999999999}]},{"osd":2,"last update":"Wed Aug 23 04:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.58699999999999997},"min":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.72599999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.495,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.50600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740724,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.45600000000000002,"5min":0.378,"15min":0.247},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.56299999999999994},"min":{"1min":0.50700000000000001,"5min":0.34100000000000003,"15min":0.33800000000000002},"max":{"1min":0.63700000000000001,"5min":0.74399999999999999,"15min":0.95499999999999996},"last":0.56000000000000005}]},{"osd":2,"last update":"Wed Aug 23 04:13:01 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.61199999999999999},"min":{"1min":0.498,"5min":0.46800000000000003,"15min":0.41699999999999998},"max":{"1min":0.71899999999999997,"5min":0.76100000000000001,"15min":1.4330000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69499999999999995,"15min":0.68400000000000005},"min":{"1min":0.52100000000000002,"5min":0.51200000000000001,"15min":0.34399999999999997},"max":{"1min":0.79000000000000004,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.65600000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:13:52.982 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:13:52.983 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:13:52.983 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-08-23T04:13:53.276 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-08-23T04:13:53.285 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-08-23T04:13:53.407 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:53.404+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:53.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:53.460+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:53.558 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-08-23T04:13:53.568 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:13:54.381 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:54.376+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:54.493 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:54.488+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:55.416 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:55.412+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:55.538 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:55.532+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:56.467 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:56.464+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:56.491 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:56.484+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:57.466 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:57.460+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:57.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:57.536+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:58.501 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:58.496+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:58.566 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:58.560+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:13:59.537 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:13:59.532+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:13:59.556 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:13:59.552+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:00.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:00.536+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:00.565 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:00.560+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:01.512 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:01.508+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:01.600 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:01.596+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:02.536 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:02.532+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:02.614 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:02.608+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:03.545 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:03.540+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:03.605 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:03.600+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:04.516 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:04.512+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:04.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:04.600+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:05.563 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:05.560+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:05.607 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:05.604+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:06.532 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:06.528+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:06.577 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:06.572+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:07.543 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:07.540+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:07.625 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:07.620+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:08.585 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:08.580+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:08.628 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:08.624+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:09.600 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:09.596+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:09.637 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:09.632+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:10.580 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:10.576+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:10.614 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:10.608+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:11.548 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:11.544+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:11.585 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:11.580+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:12.550 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:12.544+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:12.614 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:12.608+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:13.569 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:14:13.581 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:13.576+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:13.630 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:13.624+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:13.850 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:14:13.853 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:14:13.863 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6047,"stamp":"2023-08-23T04:14:13.131839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003287"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740733,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.40300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0009999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.46100000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66200000000000003,"5min":0.69799999999999995,"15min":0.77600000000000002},"last":0.59999999999999998}]},{"osd":1,"last update":"Wed Aug 23 04:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57699999999999996,"15min":0.57599999999999996},"min":{"1min":0.51500000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.68400000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66200000000000003,"15min":0.66500000000000004},"min":{"1min":0.58199999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.754,"5min":0.80500000000000005,"15min":0.84199999999999997},"last":0.63900000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740730,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:13:19 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.52700000000000002,"15min":0.53000000000000003},"min":{"1min":0.42699999999999999,"5min":0.39600000000000002,"15min":0.316},"max":{"1min":0.74199999999999999,"5min":0.753,"15min":0.753},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.66800000000000004,"15min":0.67100000000000004},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.79800000000000004,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.77500000000000002}]},{"osd":2,"last update":"Wed Aug 23 04:13:06 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.621,"15min":0.58699999999999997},"min":{"1min":0.48799999999999999,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.72599999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.61299999999999999,"15min":0.61499999999999999},"min":{"1min":0.495,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.82099999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.57299999999999995}]}]},{"osd":0,"up_from":8,"seq":34359740728,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.45600000000000002,"5min":0.378,"15min":0.247},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.56299999999999994},"min":{"1min":0.50700000000000001,"5min":0.34100000000000003,"15min":0.33800000000000002},"max":{"1min":0.63700000000000001,"5min":0.74399999999999999,"15min":0.95499999999999996},"last":0.52000000000000002}]},{"osd":2,"last update":"Wed Aug 23 04:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59899999999999998,"15min":0.61199999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":1.4330000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.76300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:14:13.864 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:14:13.865 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:14:13.865 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:14:14.572 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:14.568+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:14.653 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:14.648+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:15.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:15.612+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:15.618 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:15.612+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:16.588 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:16.584+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:16.616 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:16.612+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:17.546 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:17.540+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:17.665 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:17.660+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:18.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:18.556+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:18.634 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:18.628+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:19.540 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:19.536+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:19.635 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:19.632+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:20.503 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:20.496+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:20.655 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:20.652+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:21.536 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:21.532+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:21.647 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:21.640+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:22.530 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:22.524+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:22.692 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:22.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:23.540 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:23.536+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:23.708 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:23.704+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:24.515 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:24.512+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:24.731 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:24.728+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:25.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:25.468+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:25.687 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:25.684+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:26.446 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:26.440+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:26.694 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:26.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:27.496 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:27.492+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:27.668 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:27.664+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:28.514 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:28.508+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:28.691 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:28.688+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:29.528 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:29.524+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:29.652 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:29.648+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:30.486 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:30.480+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:30.620 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:30.616+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:31.448 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:31.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:31.604 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:31.600+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:32.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:32.460+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:32.590 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:32.584+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:33.423 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:33.420+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:33.580 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:33.576+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:33.866 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:14:34.154 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:14:34.157 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:14:34.168 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6057,"stamp":"2023-08-23T04:14:33.137205+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003169"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740737,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.40300000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":1.0009999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.57199999999999995},"min":{"1min":0.46100000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.66200000000000003,"5min":0.69799999999999995,"15min":0.77600000000000002},"last":0.61799999999999999}]},{"osd":1,"last update":"Wed Aug 23 04:13:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.57699999999999996,"15min":0.57599999999999996},"min":{"1min":0.51500000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.68400000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66200000000000003,"15min":0.66500000000000004},"min":{"1min":0.58199999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.754,"5min":0.80500000000000005,"15min":0.84199999999999997},"last":0.79000000000000004}]}]},{"osd":1,"up_from":8,"seq":34359740734,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.44600000000000001,"5min":0.39600000000000002,"15min":0.316},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.61299999999999999,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.83599999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.73699999999999999}]},{"osd":2,"last update":"Wed Aug 23 04:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.58899999999999997},"min":{"1min":0.51800000000000002,"5min":0.48799999999999999,"15min":0.40699999999999997},"max":{"1min":0.72299999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.50600000000000001,"5min":0.45900000000000002,"15min":0.38500000000000001},"max":{"1min":0.67200000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.54000000000000004}]}]},{"osd":0,"up_from":8,"seq":34359740732,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:13:33 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.52800000000000002,"15min":0.52100000000000002},"min":{"1min":0.45600000000000002,"5min":0.378,"15min":0.247},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56000000000000005,"15min":0.56299999999999994},"min":{"1min":0.50700000000000001,"5min":0.34100000000000003,"15min":0.33800000000000002},"max":{"1min":0.63700000000000001,"5min":0.74399999999999999,"15min":0.95499999999999996},"last":0.56799999999999995}]},{"osd":2,"last update":"Wed Aug 23 04:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59899999999999998,"15min":0.61199999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":1.4330000000000001},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:14:34.170 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:14:34.171 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:14:34.171 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:14:34.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:34.372+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:34.606 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:34.600+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:35.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:35.376+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:35.562 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:35.556+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:36.416 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:36.411+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:36.574 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:36.567+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:37.370 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:37.363+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:37.597 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:37.591+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:38.372 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:38.367+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:38.569 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:38.563+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:39.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:39.375+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:39.596 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:39.591+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:40.351 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:40.347+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:40.548 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:40.543+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:41.374 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:41.367+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:41.524 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:41.519+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:42.352 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:42.347+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:42.550 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:42.543+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:43.402 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:43.395+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:43.531 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:43.527+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:44.364 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:44.359+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:44.574 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:44.567+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:45.373 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:45.367+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:45.603 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:45.599+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:46.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:46.379+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:46.623 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:46.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:47.372 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:47.367+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:47.609 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:47.603+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:48.340 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:48.335+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:48.593 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:48.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:49.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:49.363+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:49.559 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:49.551+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:50.390 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:50.383+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:50.562 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:50.555+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:51.354 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:51.347+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:51.552 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:51.547+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:52.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:52.363+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:52.526 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:52.519+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:53.345 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:53.339+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:53.555 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:53.551+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:54.173 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:14:54.301 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:54.295+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:54.460 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:14:54.463 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:14:54.473 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6067,"stamp":"2023-08-23T04:14:53.142564+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003158"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740741,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.40300000000000002},"max":{"1min":0.746,"5min":0.79700000000000004,"15min":1.0009999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.53000000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.77600000000000002},"last":0.68300000000000005}]},{"osd":1,"last update":"Wed Aug 23 04:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.51000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.72399999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.61699999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.79000000000000004,"5min":0.80500000000000005,"15min":0.84199999999999997},"last":0.74299999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740738,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.44600000000000001,"5min":0.39600000000000002,"15min":0.316},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.61299999999999999,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.83599999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.71899999999999997}]},{"osd":2,"last update":"Wed Aug 23 04:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.58899999999999997},"min":{"1min":0.51800000000000002,"5min":0.48799999999999999,"15min":0.40699999999999997},"max":{"1min":0.72299999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.50600000000000001,"5min":0.45900000000000002,"15min":0.38500000000000001},"max":{"1min":0.67200000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.64100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740736,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.40699999999999997,"5min":0.378,"15min":0.247},"max":{"1min":0.64000000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.441,"5min":0.34100000000000003,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":0.74399999999999999,"15min":0.95499999999999996},"last":0.54600000000000004}]},{"osd":2,"last update":"Wed Aug 23 04:14:03 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59899999999999998,"15min":0.61199999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":1.4330000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.68500000000000005,"15min":0.68600000000000005},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.78400000000000003,"5min":0.81799999999999995,"15min":1.2350000000000001},"last":0.52200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:14:54.475 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:14:54.476 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:14:54.476 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:14:54.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:54.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:55.285 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:55.279+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:55.564 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:55.559+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:56.280 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:56.275+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:56.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:56.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:57.292 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:57.287+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:57.629 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:57.623+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:58.302 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:58.295+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:58.617 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:58.611+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:14:59.328 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:14:59.323+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:14:59.657 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:14:59.651+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:00.369 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:00.363+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:00.648 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:00.643+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:01.413 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:01.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:01.623 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:01.619+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:02.455 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:02.451+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:02.653 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:02.647+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:03.415 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:03.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:03.614 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:03.607+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:04.386 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:04.379+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:04.639 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:04.635+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:05.411 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:05.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:05.678 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:05.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:06.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:06.435+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:06.648 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:06.643+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:07.413 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:07.407+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:07.606 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:07.599+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:08.380 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:08.375+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:08.654 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:08.647+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:09.391 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:09.387+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:09.621 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:09.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:10.407 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:10.403+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:10.623 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:10.619+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:11.380 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:11.375+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:11.641 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:11.635+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:12.335 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:12.331+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:12.626 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:12.619+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:13.381 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:13.375+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:13.592 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:13.587+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:14.353 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:14.347+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:14.477 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:15:14.574 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:14.567+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:14.766 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:15:14.768 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:15:14.784 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6077,"stamp":"2023-08-23T04:15:13.148242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003542"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740745,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.40300000000000002},"max":{"1min":0.746,"5min":0.79700000000000004,"15min":1.0009999999999999},"last":0.441},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.53000000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.77600000000000002},"last":0.47799999999999998}]},{"osd":1,"last update":"Wed Aug 23 04:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.51000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.72399999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.61699999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.79000000000000004,"5min":0.80500000000000005,"15min":0.84199999999999997},"last":0.60699999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740742,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:14:20 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.44600000000000001,"5min":0.39600000000000002,"15min":0.316},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.67800000000000005,"15min":0.67300000000000004},"min":{"1min":0.61299999999999999,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.83599999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.67200000000000004}]},{"osd":2,"last update":"Wed Aug 23 04:14:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.624,"15min":0.58899999999999997},"min":{"1min":0.51800000000000002,"5min":0.48799999999999999,"15min":0.40699999999999997},"max":{"1min":0.72299999999999998,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.50600000000000001,"5min":0.45900000000000002,"15min":0.38500000000000001},"max":{"1min":0.67200000000000004,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.56000000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740740,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.40699999999999997,"5min":0.378,"15min":0.247},"max":{"1min":0.64000000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.441,"5min":0.34100000000000003,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":0.74399999999999999,"15min":0.95499999999999996},"last":0.55900000000000005}]},{"osd":2,"last update":"Wed Aug 23 04:15:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.69399999999999995,"5min":0.81100000000000005,"15min":1.4330000000000001},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68300000000000005,"15min":0.68400000000000005},"min":{"1min":0.52200000000000002,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":1.2350000000000001},"last":0.627}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:15:14.786 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:15:14.786 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:15:14.787 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:15:15.384 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:15.379+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:15.589 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:15.583+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:16.415 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:16.411+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:16.560 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:16.555+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:17.382 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:17.375+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:17.579 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:17.571+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:18.375 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:18.371+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:18.623 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:18.615+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:19.349 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:19.343+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:19.668 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:19.663+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:20.378 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:20.371+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:20.679 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:20.675+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:21.351 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:21.347+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:21.724 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:21.719+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:22.388 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:22.383+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:22.700 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:22.695+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:23.435 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:23.431+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:23.706 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:23.699+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:24.433 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:24.427+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:24.677 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:24.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:25.474 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:25.467+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:25.673 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:25.667+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:26.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:26.435+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:26.717 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:26.711+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:27.477 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:27.471+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:27.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:27.735+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:28.443 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:28.439+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:28.696 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:28.691+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:29.410 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:29.403+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:29.734 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:29.727+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:30.460 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:30.455+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:30.783 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:30.775+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:31.431 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:31.427+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:31.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:31.815+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:32.478 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:32.471+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:32.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:32.831+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:33.506 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:33.499+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:33.797 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:33.791+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:34.473 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:34.467+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:34.788 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:15:34.808 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:34.803+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:35.075 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:15:35.078 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:15:35.088 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6087,"stamp":"2023-08-23T04:15:33.153577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002984"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740749,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53500000000000003,"15min":0.53200000000000003},"min":{"1min":0.44,"5min":0.41299999999999998,"15min":0.40300000000000002},"max":{"1min":0.746,"5min":0.79700000000000004,"15min":1.0009999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.53000000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.77600000000000002},"last":0.59399999999999997}]},{"osd":1,"last update":"Wed Aug 23 04:14:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57899999999999996,"15min":0.57699999999999996},"min":{"1min":0.51000000000000001,"5min":0.436,"15min":0.436},"max":{"1min":0.72399999999999998,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.61699999999999999,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.79000000000000004,"5min":0.80500000000000005,"15min":0.84199999999999997},"last":0.71599999999999997}]}]},{"osd":1,"up_from":8,"seq":34359740746,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.40999999999999998,"5min":0.39600000000000002,"15min":0.316},"max":{"1min":0.72199999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.81000000000000005,"5min":0.83599999999999997,"15min":0.88300000000000001},"last":0.68500000000000005}]},{"osd":2,"last update":"Wed Aug 23 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.626,"15min":0.59399999999999997},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.82299999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.61599999999999999},"min":{"1min":0.51300000000000001,"5min":0.45900000000000002,"15min":0.38500000000000001},"max":{"1min":0.71799999999999997,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.48199999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740744,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:14:36 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.40699999999999997,"5min":0.378,"15min":0.247},"max":{"1min":0.64000000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55900000000000005,"15min":0.56299999999999994},"min":{"1min":0.441,"5min":0.34100000000000003,"15min":0.33800000000000002},"max":{"1min":0.69599999999999995,"5min":0.74399999999999999,"15min":0.95499999999999996},"last":0.50800000000000001}]},{"osd":2,"last update":"Wed Aug 23 04:15:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.69399999999999995,"5min":0.81100000000000005,"15min":1.4330000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68300000000000005,"15min":0.68400000000000005},"min":{"1min":0.52200000000000002,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":1.2350000000000001},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:15:35.091 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:15:35.092 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:15:35.092 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:15:35.498 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:35.491+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:35.814 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:35.807+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:36.515 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:36.511+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:36.771 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:36.767+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:37.492 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:37.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:37.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:37.815+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:38.467 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:38.459+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:38.772 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:38.767+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:39.471 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:39.463+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:39.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:39.811+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:40.493 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:40.487+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:40.804 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:40.799+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:41.520 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:41.515+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:41.762 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:41.755+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:42.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:42.495+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:42.739 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:42.735+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:43.505 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:43.499+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:43.776 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:43.771+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:44.509 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:44.503+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:44.775 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:44.767+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:45.466 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:45.459+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:45.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:45.767+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:46.479 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:46.475+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:46.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:46.739+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:47.448 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:47.443+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:47.708 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:47.703+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:48.454 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:48.447+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:48.728 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:48.723+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:49.471 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:49.463+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:49.744 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:49.739+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:50.499 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:50.495+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:50.748 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:50.743+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:51.545 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:51.539+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:51.706 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:51.699+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:52.586 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:52.579+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:52.707 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:52.703+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:53.621 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:53.615+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:53.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:53.735+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:54.626 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:54.619+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:54.721 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:54.715+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:55.094 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:15:55.386 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:15:55.390 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:15:55.404 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6098,"stamp":"2023-08-23T04:15:55.159293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003135"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740754,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:15:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65800000000000003,"5min":0.79700000000000004,"15min":1.0009999999999999},"last":0.498},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.77600000000000002},"last":0.56000000000000005}]},{"osd":1,"last update":"Wed Aug 23 04:15:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.505,"5min":0.46200000000000002,"15min":0.436},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.57899999999999996,"5min":0.53500000000000003,"15min":0.51100000000000001},"max":{"1min":0.76700000000000002,"5min":0.80500000000000005,"15min":0.84199999999999997},"last":0.60299999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740751,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.40999999999999998,"5min":0.39600000000000002,"15min":0.316},"max":{"1min":0.72199999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.434},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.81000000000000005,"5min":0.83599999999999997,"15min":0.88300000000000001},"last":0.626}]},{"osd":2,"last update":"Wed Aug 23 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.626,"15min":0.59399999999999997},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.82299999999999995},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.61599999999999999},"min":{"1min":0.51300000000000001,"5min":0.45900000000000002,"15min":0.38500000000000001},"max":{"1min":0.71799999999999997,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.59599999999999997}]}]},{"osd":0,"up_from":8,"seq":34359740749,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.44,"5min":0.378,"15min":0.247},"max":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.46300000000000002,"5min":0.34100000000000003,"15min":0.33800000000000002},"max":{"1min":0.73199999999999998,"5min":0.74399999999999999,"15min":0.95499999999999996},"last":0.46300000000000002}]},{"osd":2,"last update":"Wed Aug 23 04:15:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.60799999999999998},"min":{"1min":0.48499999999999999,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.69399999999999995,"5min":0.81100000000000005,"15min":1.4330000000000001},"last":0.628},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68300000000000005,"15min":0.68400000000000005},"min":{"1min":0.52200000000000002,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":1.2350000000000001},"last":0.64600000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:15:55.406 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:15:55.406 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:15:55.407 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-08-23T04:15:55.588 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:55.583+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:55.683 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-08-23T04:15:55.686 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:55.679+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:55.693 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-08-23T04:15:55.972 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-08-23T04:15:55.981 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:15:56.638 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:56.631+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:56.708 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:56.703+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:57.630 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:57.623+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:57.759 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:57.755+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:58.582 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:58.575+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:58.786 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:58.779+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:15:59.592 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:15:59.587+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:15:59.764 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:15:59.759+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:00.626 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:00.619+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:00.715 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:00.711+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:01.642 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:01.635+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:01.752 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:01.747+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:02.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:02.679+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:02.801 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:02.795+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:03.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:03.695+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:03.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:03.815+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:04.732 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:04.727+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:04.862 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:04.855+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:05.720 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:05.715+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:05.899 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:05.895+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:06.718 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:06.711+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:06.911 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:06.903+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:07.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:07.731+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:07.906 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:07.899+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:08.786 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:08.779+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:08.859 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:08.855+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:09.789 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:09.783+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:09.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:09.835+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:10.771 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:10.767+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:10.824 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:10.819+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:11.805 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:11.799+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:11.865 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:11.859+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:12.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:12.791+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:12.847 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:12.843+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:13.815 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:13.811+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:13.848 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:13.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:14.768 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:14.763+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:14.857 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:14.851+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:15.748 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:15.743+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:15.907 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:15.903+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:15.982 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:16:16.272 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:16:16.275 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:16:16.286 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6108,"stamp":"2023-08-23T04:16:15.164613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003331"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740758,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:15:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65800000000000003,"5min":0.79700000000000004,"15min":1.0009999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.77600000000000002},"last":0.59699999999999998}]},{"osd":1,"last update":"Wed Aug 23 04:15:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.505,"5min":0.46200000000000002,"15min":0.436},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.57899999999999996,"5min":0.53500000000000003,"15min":0.51100000000000001},"max":{"1min":0.76700000000000002,"5min":0.80500000000000005,"15min":0.84199999999999997},"last":0.65600000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740755,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:15:23 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.40999999999999998,"5min":0.39600000000000002,"15min":0.316},"max":{"1min":0.72199999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.67300000000000004,"15min":0.67100000000000004},"min":{"1min":0.503,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.81000000000000005,"5min":0.83599999999999997,"15min":0.88300000000000001},"last":0.64400000000000002}]},{"osd":2,"last update":"Wed Aug 23 04:15:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.626,"15min":0.59399999999999997},"min":{"1min":0.51700000000000002,"5min":0.48799999999999999,"15min":0.40699999999999997},"max":{"1min":0.78800000000000003,"5min":0.81399999999999995,"15min":0.82299999999999995},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60499999999999998,"15min":0.61599999999999999},"min":{"1min":0.51300000000000001,"5min":0.45900000000000002,"15min":0.38500000000000001},"max":{"1min":0.71799999999999997,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.58099999999999996}]}]},{"osd":0,"up_from":8,"seq":34359740753,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.44,"5min":0.378,"15min":0.247},"max":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.46300000000000002,"5min":0.34100000000000003,"15min":0.33800000000000002},"max":{"1min":0.73199999999999998,"5min":0.74399999999999999,"15min":0.95499999999999996},"last":0.51800000000000002}]},{"osd":2,"last update":"Wed Aug 23 04:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.48699999999999999,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.93100000000000005},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.504,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.872,"5min":0.872,"15min":1.2350000000000001},"last":0.50600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:16:16.288 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:16:16.289 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:16:16.289 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:16:16.713 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:16.707+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:16.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:16.895+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:17.676 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:17.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:17.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:17.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:18.705 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:18.699+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:18.834 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:18.827+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:19.677 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:19.671+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:19.814 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:19.807+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:20.674 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:20.667+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:20.821 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:20.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:21.703 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:21.699+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:21.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:21.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:22.700 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:22.695+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:22.801 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:22.795+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:23.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:23.735+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:23.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:23.775+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:24.730 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:24.723+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:24.775 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:24.771+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:25.698 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:25.691+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:25.814 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:25.807+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:26.688 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:26.683+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:26.828 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:26.823+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:27.670 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:27.663+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:27.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:27.847+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:28.684 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:28.679+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:28.849 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:28.843+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:29.718 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:29.711+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:29.819 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:29.815+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:30.709 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:30.703+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:30.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:30.819+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:31.698 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:31.690+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:31.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:31.802+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:32.740 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:32.734+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:32.768 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:32.762+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:33.755 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:33.750+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:33.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:33.758+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:34.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:34.742+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:34.814 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:34.806+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:35.749 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:35.742+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:35.864 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:35.858+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:36.290 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:16:36.581 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:16:36.584 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:16:36.595 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6118,"stamp":"2023-08-23T04:16:35.169846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003202"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740762,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:15:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53000000000000003},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65800000000000003,"5min":0.79700000000000004,"15min":1.0009999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.46600000000000003,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.77600000000000002},"last":0.51300000000000001}]},{"osd":1,"last update":"Wed Aug 23 04:15:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.505,"5min":0.46200000000000002,"15min":0.436},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.57899999999999996,"5min":0.53500000000000003,"15min":0.51100000000000001},"max":{"1min":0.76700000000000002,"5min":0.80500000000000005,"15min":0.84199999999999997},"last":0.64700000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740759,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:16:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.316},"max":{"1min":0.73099999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.67200000000000004},"min":{"1min":0.56699999999999995,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.81699999999999995,"5min":0.83599999999999997,"15min":0.88300000000000001},"last":0.68999999999999995}]},{"osd":2,"last update":"Wed Aug 23 04:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.622,"15min":0.59799999999999998},"min":{"1min":0.53100000000000003,"5min":0.48799999999999999,"15min":0.40699999999999997},"max":{"1min":0.73099999999999998,"5min":0.80600000000000005,"15min":0.82299999999999995},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.48199999999999998,"5min":0.45900000000000002,"15min":0.38500000000000001},"max":{"1min":0.68300000000000005,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.54100000000000004}]}]},{"osd":0,"up_from":8,"seq":34359740757,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:15:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.52100000000000002},"min":{"1min":0.44,"5min":0.378,"15min":0.247},"max":{"1min":0.72599999999999998,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.56200000000000006},"min":{"1min":0.46300000000000002,"5min":0.34100000000000003,"15min":0.33800000000000002},"max":{"1min":0.73199999999999998,"5min":0.74399999999999999,"15min":0.95499999999999996},"last":0.54100000000000004}]},{"osd":2,"last update":"Wed Aug 23 04:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.48699999999999999,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.93100000000000005},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.504,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.872,"5min":0.872,"15min":1.2350000000000001},"last":0.71899999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:16:36.596 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:16:36.597 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:16:36.597 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:16:36.766 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:36.758+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:36.843 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:36.838+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:37.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:37.734+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:37.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:37.886+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:38.772 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:38.766+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:38.903 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:38.898+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:39.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:39.810+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:39.906 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:39.898+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:40.775 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:40.770+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:40.897 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:40.890+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:41.806 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:41.798+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:41.900 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:41.894+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:42.804 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:42.798+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:42.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:42.878+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:43.780 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:43.774+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:43.855 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:43.850+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:44.758 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:44.750+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:44.821 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:44.814+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:45.788 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:45.782+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:45.839 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:45.834+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:46.770 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:46.762+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:46.794 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:46.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:47.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:47.738+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:47.748 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:47.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:48.738 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:48.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:48.787 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:48.782+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:49.751 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:49.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:49.800 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:49.794+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:50.706 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:50.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:50.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:50.806+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:51.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:51.738+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:51.789 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:51.782+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:52.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:52.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:52.828 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:52.822+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:53.745 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:53.738+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:53.837 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:53.830+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:54.721 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:54.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:54.875 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:54.870+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:55.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:55.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:55.860 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:55.854+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:56.598 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:16:56.721 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:56.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:56.858 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:56.850+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:57.096 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:16:57.099 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:16:57.109 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6128,"stamp":"2023-08-23T04:16:55.175012+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003007"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740766,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65200000000000002,"5min":0.79700000000000004,"15min":1.0009999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.51300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69099999999999995,"5min":0.71599999999999997,"15min":0.74199999999999999},"last":0.49099999999999999}]},{"osd":1,"last update":"Wed Aug 23 04:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.51800000000000002,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.69399999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.60099999999999998,"5min":0.54700000000000004,"15min":0.51100000000000001},"max":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.84199999999999997},"last":0.629}]}]},{"osd":1,"up_from":8,"seq":34359740763,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:16:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.316},"max":{"1min":0.73099999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.67200000000000004},"min":{"1min":0.56699999999999995,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.81699999999999995,"5min":0.83599999999999997,"15min":0.88300000000000001},"last":0.64900000000000002}]},{"osd":2,"last update":"Wed Aug 23 04:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.622,"15min":0.59799999999999998},"min":{"1min":0.53100000000000003,"5min":0.48799999999999999,"15min":0.40699999999999997},"max":{"1min":0.73099999999999998,"5min":0.80600000000000005,"15min":0.82299999999999995},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.48199999999999998,"5min":0.45900000000000002,"15min":0.38500000000000001},"max":{"1min":0.68300000000000005,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.55500000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740761,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.42099999999999999,"5min":0.378,"15min":0.247},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.45700000000000002,"5min":0.34100000000000003,"15min":0.33800000000000002},"max":{"1min":0.65500000000000003,"5min":0.74399999999999999,"15min":0.95499999999999996},"last":0.51600000000000001}]},{"osd":2,"last update":"Wed Aug 23 04:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.48699999999999999,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.93100000000000005},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.504,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.872,"5min":0.872,"15min":1.2350000000000001},"last":0.63700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:16:57.111 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:16:57.111 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:16:57.111 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:16:57.693 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:57.686+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:57.834 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:57.826+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:58.664 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:58.658+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:58.830 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:58.822+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:16:59.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:16:59.662+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:16:59.830 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:16:59.822+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:00.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:00.710+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:00.838 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:00.830+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:01.675 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:01.670+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:01.887 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:01.882+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:02.652 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:02.646+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:02.933 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:02.926+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:03.633 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:03.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:03.933 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:03.926+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:04.633 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:04.626+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:04.898 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:04.890+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:05.626 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:05.618+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:05.936 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:05.930+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:06.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:06.662+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:06.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:06.930+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:07.712 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:07.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:07.940 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:07.934+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:08.743 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:08.738+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:08.939 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:08.934+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:09.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:09.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:09.928 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:09.922+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:10.743 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:10.738+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:10.969 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:10.962+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:11.726 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:11.718+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:11.972 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:11.966+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:12.754 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:12.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:13.018 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:13.010+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:13.771 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:13.766+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:14.063 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:14.058+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:14.748 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:14.742+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:15.049 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:15.042+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:15.720 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:15.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:16.047 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:16.042+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:16.721 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:16.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:17.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:17.078+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:17.112 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:17:17.405 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:17:17.408 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:17:17.417 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6139,"stamp":"2023-08-23T04:17:17.181333+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003480"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740770,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65200000000000002,"5min":0.79700000000000004,"15min":1.0009999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.51300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69099999999999995,"5min":0.71599999999999997,"15min":0.74199999999999999},"last":0.65100000000000002}]},{"osd":1,"last update":"Wed Aug 23 04:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.51800000000000002,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.69399999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.60099999999999998,"5min":0.54700000000000004,"15min":0.51100000000000001},"max":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.84199999999999997},"last":0.61899999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740767,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:16:25 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.41199999999999998,"5min":0.39600000000000002,"15min":0.316},"max":{"1min":0.73099999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.443},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67400000000000004,"15min":0.67200000000000004},"min":{"1min":0.56699999999999995,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.81699999999999995,"5min":0.83599999999999997,"15min":0.88300000000000001},"last":0.74199999999999999}]},{"osd":2,"last update":"Wed Aug 23 04:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.622,"15min":0.59799999999999998},"min":{"1min":0.53100000000000003,"5min":0.48799999999999999,"15min":0.40699999999999997},"max":{"1min":0.73099999999999998,"5min":0.80600000000000005,"15min":0.82299999999999995},"last":0.627},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60099999999999998,"15min":0.61299999999999999},"min":{"1min":0.48199999999999998,"5min":0.45900000000000002,"15min":0.38500000000000001},"max":{"1min":0.68300000000000005,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.55300000000000005}]}]},{"osd":0,"up_from":8,"seq":34359740765,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.42099999999999999,"5min":0.378,"15min":0.247},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.45700000000000002,"5min":0.34100000000000003,"15min":0.33800000000000002},"max":{"1min":0.65500000000000003,"5min":0.74399999999999999,"15min":0.95499999999999996},"last":0.60499999999999998}]},{"osd":2,"last update":"Wed Aug 23 04:16:11 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59599999999999997,"15min":0.60399999999999998},"min":{"1min":0.48699999999999999,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.93100000000000005},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.68500000000000005,"15min":0.68400000000000005},"min":{"1min":0.504,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.872,"5min":0.872,"15min":1.2350000000000001},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:17:17.419 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:17:17.420 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:17:17.420 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:17:17.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:17.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:18.043 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:18.038+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:18.670 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:18.662+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:19.062 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:19.054+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:19.711 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:19.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:20.033 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:20.026+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:20.716 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:20.710+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:20.986 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:20.978+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:21.700 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:21.694+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:21.952 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:21.946+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:22.663 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:22.658+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:22.938 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:22.930+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:23.702 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:23.694+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:23.947 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:23.942+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:24.662 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:24.654+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:24.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:24.918+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:25.712 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:25.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:25.904 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:25.894+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:26.705 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:26.698+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:26.857 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:26.850+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:27.683 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:27.678+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:27.810 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:27.802+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:28.674 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:28.666+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:28.769 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:28.762+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:29.679 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:29.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:29.808 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:29.802+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:30.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:30.710+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:30.850 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:30.842+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:31.682 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:31.674+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:31.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:31.814+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:32.688 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:32.682+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:32.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:32.842+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:33.666 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:33.658+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:33.829 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:33.822+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:34.619 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:34.614+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:34.782 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:34.774+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:35.658 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:35.650+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:35.754 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:35.746+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:36.644 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:36.638+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:36.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:36.738+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:37.421 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:17:37.602 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:37.594+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:37.707 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:17:37.710 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:17:37.720 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6149,"stamp":"2023-08-23T04:17:37.186985+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003673"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740774,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53200000000000003,"15min":0.53100000000000003},"min":{"1min":0.42399999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65200000000000002,"5min":0.79700000000000004,"15min":1.0009999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.51300000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.69099999999999995,"5min":0.71599999999999997,"15min":0.74199999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Wed Aug 23 04:16:41 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.51800000000000002,"5min":0.46999999999999997,"15min":0.436},"max":{"1min":0.69399999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67000000000000004,"15min":0.66800000000000004},"min":{"1min":0.60099999999999998,"5min":0.54700000000000004,"15min":0.51100000000000001},"max":{"1min":0.78200000000000003,"5min":0.79000000000000004,"15min":0.84199999999999997},"last":0.66900000000000004}]}]},{"osd":1,"up_from":8,"seq":34359740771,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.316},"max":{"1min":0.78600000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.505},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.52000000000000002,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.78700000000000003,"5min":0.83599999999999997,"15min":0.88300000000000001},"last":0.753}]},{"osd":2,"last update":"Wed Aug 23 04:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.621,"15min":0.60099999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.628},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.38500000000000001},"max":{"1min":0.71499999999999997,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.65900000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740769,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.42099999999999999,"5min":0.378,"15min":0.247},"max":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.502},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.55700000000000005,"15min":0.56000000000000005},"min":{"1min":0.45700000000000002,"5min":0.34100000000000003,"15min":0.33800000000000002},"max":{"1min":0.65500000000000003,"5min":0.74399999999999999,"15min":0.95499999999999996},"last":0.61299999999999999}]},{"osd":2,"last update":"Wed Aug 23 04:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.82399999999999995,"15min":0.93100000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67800000000000005,"15min":0.68400000000000005},"min":{"1min":0.50600000000000001,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.755,"5min":0.872,"15min":1.2350000000000001},"last":0.72799999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:17:37.722 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:17:37.723 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:17:37.723 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:17:37.776 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:37.770+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:38.610 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:38.602+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:38.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:38.786+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:39.637 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:39.630+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:39.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:39.814+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:40.638 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:40.630+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:40.818 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:40.810+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:41.614 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:41.606+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:41.821 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:41.814+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:42.635 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:42.630+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:42.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:42.766+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:43.656 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:43.650+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:43.743 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:43.738+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:44.699 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:44.694+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:44.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:44.738+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:45.746 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:45.738+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:45.750 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:45.742+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:46.747 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:46.742+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:46.758 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:46.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:47.714 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:47.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:47.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:47.790+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:48.761 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:48.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:48.789 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:48.782+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:49.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:49.786+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:49.807 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:49.802+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:50.799 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:50.794+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:50.825 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:50.818+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:51.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:51.790+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:51.817 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:51.810+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:52.778 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:52.770+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:52.793 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:52.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:53.748 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:53.742+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:53.796 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:53.790+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:54.782 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:54.774+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:54.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:54.778+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:55.760 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:55.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:55.825 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:55.818+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:56.735 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:56.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:56.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:56.850+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:57.725 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:17:57.774 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:57.766+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:57.837 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:57.830+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:58.016 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:17:58.019 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:17:58.029 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6159,"stamp":"2023-08-23T04:17:57.192513+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003400"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740778,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.56799999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.40200000000000002},"max":{"1min":0.66900000000000004,"5min":0.71599999999999997,"15min":0.74199999999999999},"last":0.60299999999999998}]},{"osd":1,"last update":"Wed Aug 23 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.436},"max":{"1min":0.73199999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.51100000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.84199999999999997},"last":0.74199999999999999}]}]},{"osd":1,"up_from":8,"seq":34359740775,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.316},"max":{"1min":0.78600000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.503},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.52000000000000002,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.78700000000000003,"5min":0.83599999999999997,"15min":0.88300000000000001},"last":0.55800000000000005}]},{"osd":2,"last update":"Wed Aug 23 04:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.621,"15min":0.60099999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.38500000000000001},"max":{"1min":0.71499999999999997,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.67300000000000004}]}]},{"osd":0,"up_from":8,"seq":34359740773,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.247},"max":{"1min":0.69399999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.433},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.44400000000000001,"5min":0.441,"15min":0.33800000000000002},"max":{"1min":0.63200000000000001,"5min":0.73199999999999998,"15min":0.95499999999999996},"last":0.51000000000000001}]},{"osd":2,"last update":"Wed Aug 23 04:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.82399999999999995,"15min":0.93100000000000005},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67800000000000005,"15min":0.68400000000000005},"min":{"1min":0.50600000000000001,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.755,"5min":0.872,"15min":1.2350000000000001},"last":0.64000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:17:58.030 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:17:58.031 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:17:58.031 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-08-23T04:17:58.309 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-08-23T04:17:58.319 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-08-23T04:17:58.596 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-08-23T04:17:58.610 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:17:58.803 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:58.794+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:17:58.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:58.842+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:59.828 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:17:59.822+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:17:59.852 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:17:59.846+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:00.826 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:00.818+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:00.855 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:00.850+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:01.791 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:01.782+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:01.839 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:01.834+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:02.776 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:02.770+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:02.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:02.798+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:03.772 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:03.766+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:03.795 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:03.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:04.759 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:04.754+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:04.817 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:04.810+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:05.711 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:05.706+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:05.778 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:05.770+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:06.720 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:06.714+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:06.792 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:06.786+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:07.740 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:07.734+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:07.753 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:07.746+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:08.729 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:08.722+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:08.758 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:08.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:09.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:09.706+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:09.730 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:09.722+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:10.743 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:10.734+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:10.744 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:10.738+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:11.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:11.754+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:11.784 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:11.778+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:12.766 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:12.758+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:12.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:12.806+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:13.722 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:13.714+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:13.834 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:13.826+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:14.737 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:14.730+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:14.818 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:14.810+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:15.758 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:15.750+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:15.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:15.786+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:16.802 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:16.794+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:16.839 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:16.834+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:17.800 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:17.794+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:17.811 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:17.802+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:18.611 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:18:18.807 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:18.802+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:18.860 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:18.854+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:18.901 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:18:18.904 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:18:18.914 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6169,"stamp":"2023-08-23T04:18:17.198186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003471"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740782,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.56799999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.40200000000000002},"max":{"1min":0.66900000000000004,"5min":0.71599999999999997,"15min":0.74199999999999999},"last":0.60799999999999998}]},{"osd":1,"last update":"Wed Aug 23 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.436},"max":{"1min":0.73199999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.51100000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.84199999999999997},"last":0.66500000000000004}]}]},{"osd":1,"up_from":8,"seq":34359740779,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:17:30 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.316},"max":{"1min":0.78600000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.67700000000000005,"15min":0.67600000000000005},"min":{"1min":0.52000000000000002,"5min":0.46800000000000003,"15min":0.41399999999999998},"max":{"1min":0.78700000000000003,"5min":0.83599999999999997,"15min":0.88300000000000001},"last":0.69199999999999995}]},{"osd":2,"last update":"Wed Aug 23 04:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.621,"15min":0.60099999999999998},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59999999999999998,"15min":0.61199999999999999},"min":{"1min":0.52200000000000002,"5min":0.48199999999999998,"15min":0.38500000000000001},"max":{"1min":0.71499999999999997,"5min":0.82099999999999995,"15min":0.95999999999999996},"last":0.61899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359740777,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.247},"max":{"1min":0.69399999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.629},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.44400000000000001,"5min":0.441,"15min":0.33800000000000002},"max":{"1min":0.63200000000000001,"5min":0.73199999999999998,"15min":0.95499999999999996},"last":0.56999999999999995}]},{"osd":2,"last update":"Wed Aug 23 04:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60299999999999998,"15min":0.60399999999999998},"min":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.80400000000000005,"5min":0.82399999999999995,"15min":0.93100000000000005},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.67800000000000005,"15min":0.68400000000000005},"min":{"1min":0.50600000000000001,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.755,"5min":0.872,"15min":1.2350000000000001},"last":0.78300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:18:18.916 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:18:18.917 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:18:18.917 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:18:19.809 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:19.802+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:19.870 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:19.862+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:20.823 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:20.818+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:20.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:20.842+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:21.844 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:21.838+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:21.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:21.846+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:22.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:22.846+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:22.877 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:22.870+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:23.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:23.810+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:23.904 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:23.898+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:24.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:24.786+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:24.941 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:24.934+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:25.783 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:25.777+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:25.949 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:25.941+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:26.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:26.805+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:26.908 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:26.901+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:27.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:27.785+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:27.930 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:27.921+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:28.844 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:28.837+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:28.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:28.901+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:29.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:29.809+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:29.893 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:29.885+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:30.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:30.789+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:30.873 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:30.865+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:31.770 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:31.761+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:31.828 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:31.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:32.736 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:32.729+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:32.822 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:32.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:33.750 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:33.741+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:33.839 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:33.833+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:34.708 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:34.701+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:34.831 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:34.821+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:35.754 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:35.749+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:35.812 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:35.805+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:36.795 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:36.789+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:36.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:36.801+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:37.816 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:37.813+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:37.832 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:37.829+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:38.785 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:38.781+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:38.832 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:38.829+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:38.919 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:18:39.202 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:18:39.205 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:18:39.214 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6179,"stamp":"2023-08-23T04:18:37.203474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003132"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740786,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.52600000000000002,"15min":0.52800000000000002},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.56799999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57499999999999996,"15min":0.57199999999999995},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.40200000000000002},"max":{"1min":0.66900000000000004,"5min":0.71599999999999997,"15min":0.74199999999999999},"last":0.55300000000000005}]},{"osd":1,"last update":"Wed Aug 23 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58699999999999997,"15min":0.57999999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.436},"max":{"1min":0.73199999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.67100000000000004,"15min":0.66800000000000004},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.51100000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.84199999999999997},"last":0.60499999999999998}]}]},{"osd":1,"up_from":8,"seq":34359740783,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.316},"max":{"1min":0.70199999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.54800000000000004,"5min":0.503,"15min":0.41399999999999998},"max":{"1min":0.79600000000000004,"5min":0.83599999999999997,"15min":0.88300000000000001},"last":0.73699999999999999}]},{"osd":2,"last update":"Wed Aug 23 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.627,"15min":0.60499999999999998},"min":{"1min":0.55300000000000005,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.78100000000000003,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.624},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59899999999999998,"15min":0.61099999999999999},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.38500000000000001},"max":{"1min":0.69999999999999996,"5min":0.71799999999999997,"15min":0.95999999999999996},"last":0.64700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740781,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:17:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.435,"5min":0.40699999999999997,"15min":0.247},"max":{"1min":0.69399999999999995,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.501},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55700000000000005,"15min":0.55900000000000005},"min":{"1min":0.44400000000000001,"5min":0.441,"15min":0.33800000000000002},"max":{"1min":0.63200000000000001,"5min":0.73199999999999998,"15min":0.95499999999999996},"last":0.63100000000000001}]},{"osd":2,"last update":"Wed Aug 23 04:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.51900000000000002,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.93100000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67400000000000004,"15min":0.68600000000000005},"min":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.872,"15min":1.2350000000000001},"last":0.67100000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:18:39.216 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:18:39.216 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:18:39.217 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:18:39.746 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:39.741+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:39.797 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:39.793+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:40.705 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:40.701+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:40.840 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:40.837+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:41.684 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:41.681+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:41.851 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:41.849+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:42.704 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:42.701+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:42.813 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:42.809+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:43.672 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:43.669+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:43.843 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:43.841+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:44.706 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:44.701+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:44.892 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:44.889+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:45.659 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:45.657+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:45.943 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:45.937+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:46.622 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:46.617+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:46.959 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:46.957+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:47.637 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:47.633+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:47.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:47.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:48.689 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:48.685+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:48.976 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:48.973+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:49.683 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:49.681+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:50.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:50.017+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:50.701 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:50.697+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:50.997 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:50.993+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:51.742 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:51.737+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:52.000 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:51.997+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:52.755 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:52.753+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:53.042 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:53.037+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:53.765 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:53.761+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:54.033 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:54.029+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:54.796 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:54.793+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:55.004 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:55.001+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:55.798 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:55.793+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:56.018 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:56.013+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:56.772 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:56.769+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:57.044 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:57.041+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:57.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:57.809+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:58.027 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:58.025+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:58.841 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:58.837+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:18:59.022 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:18:59.017+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:18:59.218 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:18:59.514 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:18:59.517 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:18:59.527 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6190,"stamp":"2023-08-23T04:18:59.209646+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003357"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740791,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.439,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70099999999999996,"5min":0.746,"15min":0.79700000000000004},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.40200000000000002},"max":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.74199999999999999},"last":0.47599999999999998}]},{"osd":1,"last update":"Wed Aug 23 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.51200000000000001,"5min":0.496,"15min":0.436},"max":{"1min":0.66000000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.622},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.51100000000000001},"max":{"1min":0.75800000000000001,"5min":0.80100000000000005,"15min":0.84199999999999997},"last":0.71399999999999997}]}]},{"osd":1,"up_from":8,"seq":34359740788,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.316},"max":{"1min":0.70199999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.54800000000000004,"5min":0.503,"15min":0.41399999999999998},"max":{"1min":0.79600000000000004,"5min":0.83599999999999997,"15min":0.88300000000000001},"last":0.80200000000000005}]},{"osd":2,"last update":"Wed Aug 23 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.627,"15min":0.60499999999999998},"min":{"1min":0.55300000000000005,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.78100000000000003,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59899999999999998,"15min":0.61099999999999999},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.38500000000000001},"max":{"1min":0.69999999999999996,"5min":0.71799999999999997,"15min":0.95999999999999996},"last":0.622}]}]},{"osd":0,"up_from":8,"seq":34359740786,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:18:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.247},"max":{"1min":0.71799999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.623},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.33800000000000002},"max":{"1min":0.73099999999999998,"5min":0.73199999999999998,"15min":0.95499999999999996},"last":0.499}]},{"osd":2,"last update":"Wed Aug 23 04:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.51900000000000002,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.93100000000000005},"last":0.749},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67400000000000004,"15min":0.68600000000000005},"min":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.872,"15min":1.2350000000000001},"last":0.77300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:18:59.529 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:18:59.529 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:18:59.530 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:18:59.801 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:18:59.797+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:00.014 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:00.009+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:00.787 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:00.781+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:00.973 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:00.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:01.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:01.789+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:01.967 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:01.965+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:02.822 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:02.817+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:02.972 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:02.969+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:03.800 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:03.797+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:04.017 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:04.013+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:04.764 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:04.761+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:05.025 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:05.021+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:05.778 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:05.773+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:06.053 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:06.049+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:06.768 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:06.765+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:07.078 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:07.073+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:07.770 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:07.765+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:08.091 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:08.089+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:08.738 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:08.733+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:09.082 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:09.077+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:09.713 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:09.709+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:10.065 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:10.061+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:10.736 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:10.733+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:11.105 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:11.101+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:11.696 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:11.693+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:12.134 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:12.129+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:12.715 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:12.709+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:13.131 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:13.129+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:13.698 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:13.693+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:14.111 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:14.109+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:14.720 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:14.717+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:15.131 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:15.129+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:15.725 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:15.721+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:16.147 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:16.145+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:16.744 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:16.741+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:17.140 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:17.137+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:17.762 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:17.757+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:18.100 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:18.097+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:18.767 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:18.761+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:19.119 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:19.117+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:19.530 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:19:19.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:19.801+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:19.821 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:19:19.823 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:19:19.834 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6200,"stamp":"2023-08-23T04:19:19.214988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003086"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740795,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.439,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70099999999999996,"5min":0.746,"15min":0.79700000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.40200000000000002},"max":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.74199999999999999},"last":0.58099999999999996}]},{"osd":1,"last update":"Wed Aug 23 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.51200000000000001,"5min":0.496,"15min":0.436},"max":{"1min":0.66000000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.51100000000000001},"max":{"1min":0.75800000000000001,"5min":0.80100000000000005,"15min":0.84199999999999997},"last":0.64200000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740792,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52400000000000002,"15min":0.52700000000000002},"min":{"1min":0.42499999999999999,"5min":0.40300000000000002,"15min":0.316},"max":{"1min":0.70199999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.435},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.68000000000000005,"15min":0.67500000000000004},"min":{"1min":0.54800000000000004,"5min":0.503,"15min":0.41399999999999998},"max":{"1min":0.79600000000000004,"5min":0.83599999999999997,"15min":0.88300000000000001},"last":0.71899999999999997}]},{"osd":2,"last update":"Wed Aug 23 04:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.627,"15min":0.60499999999999998},"min":{"1min":0.55300000000000005,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.78100000000000003,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59899999999999998,"15min":0.61099999999999999},"min":{"1min":0.50600000000000001,"5min":0.48199999999999998,"15min":0.38500000000000001},"max":{"1min":0.69999999999999996,"5min":0.71799999999999997,"15min":0.95999999999999996},"last":0.52600000000000002}]}]},{"osd":0,"up_from":8,"seq":34359740790,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:18:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.247},"max":{"1min":0.71799999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.33800000000000002},"max":{"1min":0.73099999999999998,"5min":0.73199999999999998,"15min":0.95499999999999996},"last":0.58899999999999997}]},{"osd":2,"last update":"Wed Aug 23 04:18:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60599999999999998,"15min":0.60099999999999998},"min":{"1min":0.51900000000000002,"5min":0.46899999999999997,"15min":0.41699999999999998},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.93100000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.67400000000000004,"15min":0.68600000000000005},"min":{"1min":0.52300000000000002,"5min":0.47099999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.872,"15min":1.2350000000000001},"last":0.70999999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:19:19.836 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:19:19.836 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:19:19.837 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:19:20.119 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:20.117+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:20.841 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:20.837+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:21.161 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:21.157+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:21.867 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:21.865+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:22.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:22.185+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:22.868 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:22.865+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:23.208 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:23.205+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:23.916 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:23.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:24.188 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:24.185+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:24.876 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:24.873+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:25.162 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:25.157+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:25.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:25.829+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:26.193 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:26.189+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:26.819 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:26.817+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:27.188 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:27.181+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:27.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:27.813+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:28.195 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:28.193+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:28.800 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:28.797+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:29.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:29.173+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:29.832 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:29.829+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:30.141 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:30.137+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:30.847 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:30.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:31.153 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:31.149+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:31.806 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:31.801+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:32.143 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:32.141+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:32.855 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:32.853+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:33.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:33.185+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:33.844 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:33.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:34.204 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:34.201+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:34.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:34.805+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:35.240 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:35.237+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:35.792 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:35.789+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:36.230 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:36.225+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:36.771 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:36.769+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:37.264 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:37.261+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:37.762 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:37.757+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:38.275 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:38.269+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:38.779 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:38.777+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:39.290 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:39.285+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:39.814 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:39.809+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:39.838 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:19:40.127 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:19:40.130 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:19:40.140 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6210,"stamp":"2023-08-23T04:19:39.220206+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003118"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740799,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.52500000000000002,"15min":0.52900000000000003},"min":{"1min":0.439,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.70099999999999996,"5min":0.746,"15min":0.79700000000000004},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57599999999999996,"15min":0.57199999999999995},"min":{"1min":0.45300000000000001,"5min":0.44800000000000001,"15min":0.40200000000000002},"max":{"1min":0.69499999999999995,"5min":0.71599999999999997,"15min":0.74199999999999999},"last":0.61399999999999999}]},{"osd":1,"last update":"Wed Aug 23 04:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.51200000000000001,"5min":0.496,"15min":0.436},"max":{"1min":0.66000000000000003,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.58899999999999997,"5min":0.56299999999999994,"15min":0.51100000000000001},"max":{"1min":0.75800000000000001,"5min":0.80100000000000005,"15min":0.84199999999999997},"last":0.65500000000000003}]}]},{"osd":1,"up_from":8,"seq":34359740796,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.316},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.57799999999999996,"5min":0.503,"15min":0.41399999999999998},"max":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.88300000000000001},"last":0.68899999999999995}]},{"osd":2,"last update":"Wed Aug 23 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63100000000000001,"15min":0.60799999999999998},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.71199999999999997,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.52600000000000002,"5min":0.48199999999999998,"15min":0.38500000000000001},"max":{"1min":0.70299999999999996,"5min":0.71799999999999997,"15min":0.95999999999999996},"last":0.65700000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740794,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:18:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.433,"5min":0.40699999999999997,"15min":0.247},"max":{"1min":0.71799999999999997,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.56000000000000005},"min":{"1min":0.46800000000000003,"5min":0.441,"15min":0.33800000000000002},"max":{"1min":0.73099999999999998,"5min":0.73199999999999998,"15min":0.95499999999999996},"last":0.59399999999999997}]},{"osd":2,"last update":"Wed Aug 23 04:19:23 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.41699999999999998},"max":{"1min":0.81799999999999995,"5min":0.83399999999999996,"15min":0.93100000000000005},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.34399999999999997},"max":{"1min":0.77300000000000002,"5min":0.872,"15min":1.2350000000000001},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:19:40.143 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:19:40.144 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:19:40.144 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:19:40.267 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:40.265+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:40.781 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:40.777+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:41.292 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:41.289+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:41.781 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:41.777+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:42.325 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:42.321+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:42.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:42.737+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:43.293 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:43.289+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:43.741 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:43.737+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:44.304 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:44.301+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:44.786 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:44.781+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:45.340 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:45.337+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:45.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:45.829+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:46.382 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:46.377+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:46.805 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:46.801+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:47.387 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:47.385+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:47.782 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:47.777+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:48.417 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:48.413+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:48.812 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:48.809+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:49.467 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:49.465+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:49.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:49.825+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:50.500 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:50.497+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:50.793 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:50.789+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:51.520 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:51.517+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:51.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:51.801+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:52.487 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:52.485+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:52.774 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:52.769+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:53.515 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:53.509+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:53.809 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:53.805+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:54.504 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:54.501+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:54.849 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:54.845+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:55.509 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:55.505+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:55.835 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:55.833+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:56.522 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:56.517+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:56.866 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:56.861+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:57.563 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:57.561+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:57.877 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:57.873+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:58.516 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:58.513+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:58.928 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:58.925+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:19:59.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:19:59.557+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:19:59.882 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:19:59.877+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:00.146 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:20:00.432 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:20:00.434 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:20:00.444 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6220,"stamp":"2023-08-23T04:19:59.225642+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003268"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740803,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:19:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64100000000000001,"5min":0.70099999999999996,"15min":0.79700000000000004},"last":0.503},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.40200000000000002},"max":{"1min":0.63500000000000001,"5min":0.71599999999999997,"15min":0.74199999999999999},"last":0.58699999999999997}]},{"osd":1,"last update":"Wed Aug 23 04:19:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.497,"5min":0.496,"15min":0.436},"max":{"1min":0.70099999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.66600000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.51100000000000001},"max":{"1min":0.71399999999999997,"5min":0.80100000000000005,"15min":0.84199999999999997},"last":0.67600000000000005}]}]},{"osd":1,"up_from":8,"seq":34359740800,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.316},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.57799999999999996,"5min":0.503,"15min":0.41399999999999998},"max":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.88300000000000001},"last":0.56200000000000006}]},{"osd":2,"last update":"Wed Aug 23 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63100000000000001,"15min":0.60799999999999998},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.71199999999999997,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.5},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.52600000000000002,"5min":0.48199999999999998,"15min":0.38500000000000001},"max":{"1min":0.70299999999999996,"5min":0.71799999999999997,"15min":0.95999999999999996},"last":0.53000000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740798,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.42099999999999999,"15min":0.247},"max":{"1min":0.63400000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.33800000000000002},"max":{"1min":0.70799999999999996,"5min":0.73199999999999998,"15min":0.95499999999999996},"last":0.56299999999999994}]},{"osd":2,"last update":"Wed Aug 23 04:19:23 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.41699999999999998},"max":{"1min":0.81799999999999995,"5min":0.83399999999999996,"15min":0.93100000000000005},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.34399999999999997},"max":{"1min":0.77300000000000002,"5min":0.872,"15min":1.2350000000000001},"last":0.68300000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:20:00.447 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:20:00.447 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:20:00.447 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.0 2023-08-23T04:20:00.605 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:00.601+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:00.725 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.0 on osd.1 to deep-scrub 2023-08-23T04:20:00.735 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg deep-scrub 3.2 2023-08-23T04:20:00.927 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:00.921+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:01.013 INFO:teuthology.orchestra.run.smithi012.stderr:instructing pg 3.2 on osd.1 to deep-scrub 2023-08-23T04:20:01.050 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:20:01.645 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:01.641+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:01.892 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:01.889+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:02.657 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:02.653+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:02.879 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:02.877+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:03.654 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:03.649+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:03.847 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:03.845+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:04.609 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:04.605+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:04.845 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:04.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:05.586 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:05.581+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:05.892 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:05.889+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:06.628 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:06.625+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:06.880 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:06.877+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:07.617 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:07.613+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:07.863 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:07.857+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:08.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:08.573+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:08.866 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:08.861+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:09.533 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:09.529+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:09.881 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:09.877+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:10.557 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:10.553+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:10.906 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:10.901+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:11.548 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:11.545+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:11.882 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:11.877+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:12.542 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:12.537+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:12.845 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:12.841+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:13.543 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:13.541+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:13.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:13.833+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:14.554 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:14.549+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:14.858 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:14.853+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:15.591 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:15.589+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:15.905 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:15.901+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:16.560 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:16.557+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:16.888 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:16.885+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:17.595 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:17.593+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:17.915 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:17.913+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:18.572 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:18.569+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:18.947 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:18.945+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:19.526 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:19.520+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:19.945 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:19.940+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:20.520 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:20.516+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:20.912 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:20.908+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:21.052 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:20:21.335 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:20:21.339 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:20:21.354 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6231,"stamp":"2023-08-23T04:20:21.231549+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003297"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740807,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:19:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64100000000000001,"5min":0.70099999999999996,"15min":0.79700000000000004},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.40200000000000002},"max":{"1min":0.63500000000000001,"5min":0.71599999999999997,"15min":0.74199999999999999},"last":0.63500000000000001}]},{"osd":1,"last update":"Wed Aug 23 04:19:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.497,"5min":0.496,"15min":0.436},"max":{"1min":0.70099999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.66600000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.51100000000000001},"max":{"1min":0.71399999999999997,"5min":0.80100000000000005,"15min":0.84199999999999997},"last":0.71399999999999997}]}]},{"osd":1,"up_from":8,"seq":34359740804,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:19:32 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.52700000000000002,"15min":0.52800000000000002},"min":{"1min":0.40500000000000003,"5min":0.40300000000000002,"15min":0.316},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.745},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67900000000000005,"15min":0.67700000000000005},"min":{"1min":0.57799999999999996,"5min":0.503,"15min":0.41399999999999998},"max":{"1min":0.80200000000000005,"5min":0.81699999999999995,"15min":0.88300000000000001},"last":0.73599999999999999}]},{"osd":2,"last update":"Wed Aug 23 04:19:22 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63100000000000001,"15min":0.60799999999999998},"min":{"1min":0.51900000000000002,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.71199999999999997,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.59699999999999998,"15min":0.60899999999999999},"min":{"1min":0.52600000000000002,"5min":0.48199999999999998,"15min":0.38500000000000001},"max":{"1min":0.70299999999999996,"5min":0.71799999999999997,"15min":0.95999999999999996},"last":0.63300000000000001}]}]},{"osd":0,"up_from":8,"seq":34359740802,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.42099999999999999,"15min":0.247},"max":{"1min":0.63400000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.33800000000000002},"max":{"1min":0.70799999999999996,"5min":0.73199999999999998,"15min":0.95499999999999996},"last":0.57899999999999996}]},{"osd":2,"last update":"Wed Aug 23 04:19:23 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.49399999999999999,"5min":0.48499999999999999,"15min":0.41699999999999998},"max":{"1min":0.81799999999999995,"5min":0.83399999999999996,"15min":0.93100000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.67700000000000005,"15min":0.68500000000000005},"min":{"1min":0.52000000000000002,"5min":0.504,"15min":0.34399999999999997},"max":{"1min":0.77300000000000002,"5min":0.872,"15min":1.2350000000000001},"last":0.63900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:20:21.356 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:20:21.357 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:20:21.358 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:20:21.521 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:21.516+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:21.950 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:21.944+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:22.476 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:22.468+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:22.997 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:22.992+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:23.441 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:23.436+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:24.005 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:24.000+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:24.450 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:24.444+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:25.052 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:25.048+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:25.434 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:25.428+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:26.035 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:26.032+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:26.439 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:26.436+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:27.079 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:27.072+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:27.478 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:27.472+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:28.085 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:28.080+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:28.516 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:28.512+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:29.090 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:29.084+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:29.537 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:29.528+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:30.061 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:30.056+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:30.576 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:30.572+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:31.071 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:31.068+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:31.590 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:31.584+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:32.112 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:32.108+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:32.626 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:32.620+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:33.064 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:33.060+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:33.629 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:33.624+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:34.070 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:34.064+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:34.672 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:34.668+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:35.042 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:35.036+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:35.634 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:35.628+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:36.002 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:35.996+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:36.663 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:36.660+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:36.989 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:36.984+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:37.643 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:37.636+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:37.973 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:37.968+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:38.686 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:38.680+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:38.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:38.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:39.681 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:39.676+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:39.928 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:39.924+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:40.714 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:40.708+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:40.894 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:40.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:41.359 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:20:41.651 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:20:41.654 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:20:41.664 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6241,"stamp":"2023-08-23T04:20:41.236688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003097"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740811,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:19:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51700000000000002,"15min":0.52600000000000002},"min":{"1min":0.38400000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64100000000000001,"5min":0.70099999999999996,"15min":0.79700000000000004},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56899999999999995,"15min":0.57099999999999995},"min":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.40200000000000002},"max":{"1min":0.63500000000000001,"5min":0.71599999999999997,"15min":0.74199999999999999},"last":0.59699999999999998}]},{"osd":1,"last update":"Wed Aug 23 04:19:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.497,"5min":0.496,"15min":0.436},"max":{"1min":0.70099999999999996,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66100000000000003,"15min":0.66600000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.51100000000000001},"max":{"1min":0.71399999999999997,"5min":0.80100000000000005,"15min":0.84199999999999997},"last":0.64800000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740808,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.316},"max":{"1min":0.745,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.56200000000000006,"5min":0.52000000000000002,"15min":0.41399999999999998},"max":{"1min":0.77100000000000002,"5min":0.81699999999999995,"15min":0.88300000000000001},"last":0.59099999999999997}]},{"osd":2,"last update":"Wed Aug 23 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.5,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.68400000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.38500000000000001},"max":{"1min":0.70899999999999996,"5min":0.71499999999999997,"15min":0.95999999999999996},"last":0.496}]}]},{"osd":0,"up_from":8,"seq":34359740806,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:19:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.42999999999999999,"5min":0.42099999999999999,"15min":0.247},"max":{"1min":0.63400000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55800000000000005,"15min":0.55900000000000005},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.33800000000000002},"max":{"1min":0.70799999999999996,"5min":0.73199999999999998,"15min":0.95499999999999996},"last":0.505}]},{"osd":2,"last update":"Wed Aug 23 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.497,"5min":0.48699999999999999,"15min":0.41699999999999998},"max":{"1min":0.69399999999999995,"5min":0.83399999999999996,"15min":0.93100000000000005},"last":0.62},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67300000000000004,"15min":0.68300000000000005},"min":{"1min":0.54200000000000004,"5min":0.504,"15min":0.34399999999999997},"max":{"1min":0.78500000000000003,"5min":0.872,"15min":1.2350000000000001},"last":0.80200000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:20:41.666 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:20:41.666 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:20:41.667 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:20:41.704 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:41.700+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:41.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:41.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:42.730 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:42.724+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:42.925 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:42.920+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:43.697 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:43.692+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:43.877 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:43.872+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:44.702 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:44.696+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:44.846 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:44.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:45.669 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:45.664+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:45.864 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:45.860+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:46.701 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:46.696+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:46.836 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:46.832+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:47.715 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:47.712+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:47.803 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:47.800+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:48.759 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:48.756+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:48.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:48.836+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:49.768 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:49.764+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:49.880 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:49.876+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:50.787 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:50.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:50.891 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:50.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:51.742 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:51.736+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:51.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:51.844+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:52.784 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:52.780+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:52.812 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:52.808+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:53.794 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:53.788+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:53.809 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:53.804+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:54.788 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:54.784+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:54.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:54.824+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:55.813 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:55.808+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:55.839 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:55.836+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:56.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:56.852+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:56.875 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:56.872+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:57.845 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:57.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:57.924 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:57.920+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:58.806 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:58.800+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:58.914 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:58.908+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:20:59.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:20:59.824+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:20:59.890 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:20:59.884+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:00.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:00.852+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:00.914 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:00.908+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:01.668 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:21:01.893 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:01.888+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:01.957 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:21:01.958 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:01.952+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:01.960 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:21:01.971 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6251,"stamp":"2023-08-23T04:21:01.242121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003308"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740815,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:20:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.47199999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.59599999999999997,"5min":0.70099999999999996,"15min":0.79700000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.48099999999999998,"5min":0.44800000000000001,"15min":0.40200000000000002},"max":{"1min":0.65000000000000002,"5min":0.69499999999999995,"15min":0.74199999999999999},"last":0.56699999999999995}]},{"osd":1,"last update":"Wed Aug 23 04:20:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.436},"max":{"1min":0.70199999999999996,"5min":0.73199999999999998,"15min":0.79700000000000004},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.59599999999999997,"5min":0.55500000000000005,"15min":0.51100000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.84199999999999997},"last":0.76700000000000002}]}]},{"osd":1,"up_from":8,"seq":34359740812,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.316},"max":{"1min":0.745,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.56200000000000006,"5min":0.52000000000000002,"15min":0.41399999999999998},"max":{"1min":0.77100000000000002,"5min":0.81699999999999995,"15min":0.88300000000000001},"last":0.627}]},{"osd":2,"last update":"Wed Aug 23 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.5,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.68400000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.38500000000000001},"max":{"1min":0.70899999999999996,"5min":0.71499999999999997,"15min":0.95999999999999996},"last":0.60399999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740810,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.52300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.247},"max":{"1min":0.70499999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.47099999999999997,"5min":0.42699999999999999,"15min":0.33800000000000002},"max":{"1min":0.65000000000000002,"5min":0.73099999999999998,"15min":0.95499999999999996},"last":0.63200000000000001}]},{"osd":2,"last update":"Wed Aug 23 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.497,"5min":0.48699999999999999,"15min":0.41699999999999998},"max":{"1min":0.69399999999999995,"5min":0.83399999999999996,"15min":0.93100000000000005},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67300000000000004,"15min":0.68300000000000005},"min":{"1min":0.54200000000000004,"5min":0.504,"15min":0.34399999999999997},"max":{"1min":0.78500000000000003,"5min":0.872,"15min":1.2350000000000001},"last":0.76000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:21:01.973 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:21:01.973 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:21:01.974 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:21:02.907 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:02.904+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:02.940 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:02.936+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:03.896 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:03.892+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:03.927 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:03.924+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:04.868 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:04.864+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:04.880 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:04.876+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:05.884 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:05.880+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:05.890 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:05.884+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:06.845 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:06.840+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:06.910 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:06.904+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:07.839 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:07.832+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:07.923 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:07.920+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:08.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:08.836+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:08.942 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:08.936+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:09.816 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:09.812+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:09.968 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:09.964+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:10.853 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:10.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:11.002 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:10.996+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:11.869 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:11.864+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:11.987 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:11.984+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:12.873 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:12.868+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:12.991 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:12.988+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:13.879 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:13.876+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:14.037 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:14.032+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:14.841 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:14.836+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:15.062 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:15.056+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:15.811 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:15.808+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:16.084 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:16.080+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:16.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:16.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:17.134 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:17.128+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:17.829 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:17.824+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:18.125 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:18.120+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:18.856 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:18.852+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:19.176 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:19.172+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:19.904 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:19.900+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:20.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:20.184+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:20.868 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:20.864+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:21.199 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:21.196+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:21.869 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:21.864+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:21.975 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:21:22.178 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:22.172+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:22.269 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:21:22.272 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:21:22.282 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6261,"stamp":"2023-08-23T04:21:21.247658+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003429"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740819,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:20:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.47199999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.59599999999999997,"5min":0.70099999999999996,"15min":0.79700000000000004},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.48099999999999998,"5min":0.44800000000000001,"15min":0.40200000000000002},"max":{"1min":0.65000000000000002,"5min":0.69499999999999995,"15min":0.74199999999999999},"last":0.55600000000000005}]},{"osd":1,"last update":"Wed Aug 23 04:20:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.436},"max":{"1min":0.70199999999999996,"5min":0.73199999999999998,"15min":0.79700000000000004},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.59599999999999997,"5min":0.55500000000000005,"15min":0.51100000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.84199999999999997},"last":0.68200000000000005}]}]},{"osd":1,"up_from":8,"seq":34359740816,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:20:35 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53300000000000003,"15min":0.53000000000000003},"min":{"1min":0.376,"5min":0.376,"15min":0.316},"max":{"1min":0.745,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68300000000000005,"15min":0.67900000000000005},"min":{"1min":0.56200000000000006,"5min":0.52000000000000002,"15min":0.41399999999999998},"max":{"1min":0.77100000000000002,"5min":0.81699999999999995,"15min":0.88300000000000001},"last":0.623}]},{"osd":2,"last update":"Wed Aug 23 04:20:25 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61899999999999999,"15min":0.60899999999999999},"min":{"1min":0.5,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.68400000000000005,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.60599999999999998},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.38500000000000001},"max":{"1min":0.70899999999999996,"5min":0.71499999999999997,"15min":0.95999999999999996},"last":0.65500000000000003}]}]},{"osd":0,"up_from":8,"seq":34359740814,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.52300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.247},"max":{"1min":0.70499999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.47099999999999997,"5min":0.42699999999999999,"15min":0.33800000000000002},"max":{"1min":0.65000000000000002,"5min":0.73099999999999998,"15min":0.95499999999999996},"last":0.51000000000000001}]},{"osd":2,"last update":"Wed Aug 23 04:20:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.61199999999999999,"15min":0.60099999999999998},"min":{"1min":0.497,"5min":0.48699999999999999,"15min":0.41699999999999998},"max":{"1min":0.69399999999999995,"5min":0.83399999999999996,"15min":0.93100000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67300000000000004,"15min":0.68300000000000005},"min":{"1min":0.54200000000000004,"5min":0.504,"15min":0.34399999999999997},"max":{"1min":0.78500000000000003,"5min":0.872,"15min":1.2350000000000001},"last":0.69899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:21:22.284 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:21:22.284 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:21:22.285 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-23T04:21:22.868 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:22.864+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:23.155 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:23.148+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:23.851 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:23.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:24.154 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:24.148+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:24.809 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:24.804+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:25.124 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:25.120+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:25.827 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:25.820+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:26.078 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:26.072+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:26.790 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:26.784+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:27.073 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:27.068+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:27.840 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:27.836+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:28.076 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:28.072+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:28.868 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:28.864+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:29.095 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:29.092+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:29.854 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:29.848+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:30.111 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:30.104+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:30.859 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:30.852+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:31.158 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:31.152+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:31.896 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:31.892+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:32.149 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:32.144+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:32.907 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:32.904+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:33.194 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:33.188+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:33.905 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:33.900+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:34.208 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:34.204+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:34.873 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:34.868+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:35.194 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:35.188+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:35.922 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:35.916+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:36.168 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:36.164+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:36.885 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:36.880+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:37.187 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:37.180+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:37.932 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:37.928+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:38.206 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:38.200+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:38.918 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:38.912+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:39.193 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:39.188+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:39.948 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:39.944+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:40.214 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:40.208+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:40.975 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:40.968+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:41.167 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:41.160+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:41.976 INFO:tasks.ceph.osd.1.smithi012.stderr:2023-08-23T04:21:41.972+0000 7f0e4c437700 -1 osd.1 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:5109 3.2 3:7d18f5e1:test1::rbd_data.29481c979d25.0000000000000047:head [write 1613824~4096 [fadvise_random] in=4096b] snapc 0=[] ondisk+write+known_if_redirected e157) 2023-08-23T04:21:42.190 INFO:tasks.ceph.osd.0.smithi012.stderr:2023-08-23T04:21:42.184+0000 7fe9a9d5f700 -1 osd.0 160 get_health_metrics reporting 256 slow ops, oldest is osd_op(client.10571.0:4014 3.1 3:a777f33a:test1::rbd_data.29481c979d25.00000000000000cf:head [write 2965504~4096 [fadvise_random] in=4096b] snapc 0=[] RETRY=5 ondisk+retry+write+known_if_redirected e157) 2023-08-23T04:21:42.285 DEBUG:teuthology.orchestra.run.smithi012:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-23T04:21:42.570 INFO:teuthology.orchestra.run.smithi012.stdout: 2023-08-23T04:21:42.573 INFO:teuthology.orchestra.run.smithi012.stderr:dumped all 2023-08-23T04:21:42.583 INFO:teuthology.orchestra.run.smithi012.stdout:{"pg_ready":true,"pg_map":{"version":6271,"stamp":"2023-08-23T04:21:41.253162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1219095996,"num_objects":566,"num_object_clones":4,"num_object_copies":1132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":451,"num_whiteouts":167,"num_read":65733,"num_read_kb":157214,"num_write":22253,"num_write_kb":8875622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":70,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1715,"num_omap_keys":172,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30473,"ondisk_log_size":30473,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":26,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1399304,"kb_used_data":487152,"kb_used_omap":0,"kb_used_meta":912128,"kb_avail":281716216,"statfs":{"total":289910292480,"available":288477405184,"internally_reserved":0,"allocated":498843648,"data_stored":496487077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":934019072},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,512],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003305"},"pg_stats":[{"pgid":"2.7","version":"160'1385","reported_seq":2288,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:42.626394+0000","last_change":"2023-08-23T04:07:42.626394+0000","last_active":"2023-08-23T04:07:42.626394+0000","last_peered":"2023-08-23T04:07:42.626394+0000","last_clean":"2023-08-23T04:07:42.626394+0000","last_became_active":"2023-08-23T00:57:56.049672+0000","last_became_peered":"2023-08-23T00:57:56.049672+0000","last_unstale":"2023-08-23T04:07:42.626394+0000","last_undegraded":"2023-08-23T04:07:42.626394+0000","last_fullsized":"2023-08-23T04:07:42.626394+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1385","last_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_deep_scrub":"160'1385","last_deep_scrub_stamp":"2023-08-23T04:07:42.626229+0000","last_clean_scrub_stamp":"2023-08-23T04:07:42.626229+0000","log_size":1385,"ondisk_log_size":1385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":146809320,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":604,"num_read_kb":3371,"num_write":1208,"num_write_kb":1109993,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":448,"num_omap_keys":35,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"160'1524","reported_seq":2453,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:40.677912+0000","last_change":"2023-08-23T04:07:40.677912+0000","last_active":"2023-08-23T04:07:40.677912+0000","last_peered":"2023-08-23T04:07:40.677912+0000","last_clean":"2023-08-23T04:07:40.677912+0000","last_became_active":"2023-08-23T00:57:56.049675+0000","last_became_peered":"2023-08-23T00:57:56.049675+0000","last_unstale":"2023-08-23T04:07:40.677912+0000","last_undegraded":"2023-08-23T04:07:40.677912+0000","last_fullsized":"2023-08-23T04:07:40.677912+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1524","last_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_deep_scrub":"160'1524","last_deep_scrub_stamp":"2023-08-23T04:07:40.677745+0000","last_clean_scrub_stamp":"2023-08-23T04:07:40.677745+0000","log_size":1524,"ondisk_log_size":1524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164024455,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":672,"num_read_kb":3671,"num_write":1330,"num_write_kb":1055290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":528,"num_omap_keys":57,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"160'1152","reported_seq":2050,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:37.585289+0000","last_change":"2023-08-23T04:07:37.585289+0000","last_active":"2023-08-23T04:07:37.585289+0000","last_peered":"2023-08-23T04:07:37.585289+0000","last_clean":"2023-08-23T04:07:37.585289+0000","last_became_active":"2023-08-23T00:57:56.046607+0000","last_became_peered":"2023-08-23T00:57:56.046607+0000","last_unstale":"2023-08-23T04:07:37.585289+0000","last_undegraded":"2023-08-23T04:07:37.585289+0000","last_fullsized":"2023-08-23T04:07:37.585289+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1152","last_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_deep_scrub":"160'1152","last_deep_scrub_stamp":"2023-08-23T04:07:37.585135+0000","last_clean_scrub_stamp":"2023-08-23T04:07:37.585135+0000","log_size":1152,"ondisk_log_size":1152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":114491527,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":611,"num_read_kb":2023,"num_write":964,"num_write_kb":1126668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":297,"num_omap_keys":33,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"160'1599","reported_seq":2457,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:34.592903+0000","last_change":"2023-08-23T04:07:34.592903+0000","last_active":"2023-08-23T04:07:34.592903+0000","last_peered":"2023-08-23T04:07:34.592903+0000","last_clean":"2023-08-23T04:07:34.592903+0000","last_became_active":"2023-08-23T00:57:56.046800+0000","last_became_peered":"2023-08-23T00:57:56.046800+0000","last_unstale":"2023-08-23T04:07:34.592903+0000","last_undegraded":"2023-08-23T04:07:34.592903+0000","last_fullsized":"2023-08-23T04:07:34.592903+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1599","last_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_deep_scrub":"160'1599","last_deep_scrub_stamp":"2023-08-23T04:07:34.592783+0000","last_clean_scrub_stamp":"2023-08-23T04:07:34.592783+0000","log_size":1599,"ondisk_log_size":1599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":164749386,"num_objects":49,"num_object_clones":2,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":2,"num_read":543,"num_read_kb":2865,"num_write":1418,"num_write_kb":1079799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":158,"num_omap_keys":17,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"160'5833","reported_seq":13155,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:41.342255+0000","last_change":"2023-08-23T04:07:41.342255+0000","last_active":"2023-08-23T04:07:41.342255+0000","last_peered":"2023-08-23T04:07:41.342255+0000","last_clean":"2023-08-23T04:07:41.342255+0000","last_became_active":"2023-08-23T00:58:02.956901+0000","last_became_peered":"2023-08-23T00:58:02.956901+0000","last_unstale":"2023-08-23T04:07:41.342255+0000","last_undegraded":"2023-08-23T04:07:41.342255+0000","last_fullsized":"2023-08-23T04:07:41.342255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'5833","last_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_deep_scrub":"160'5833","last_deep_scrub_stamp":"2023-08-23T04:07:41.342111+0000","last_clean_scrub_stamp":"2023-08-23T04:07:41.342111+0000","log_size":5833,"ondisk_log_size":5833,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":24246573,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":49,"num_read":21649,"num_read_kb":49755,"num_write":5654,"num_write_kb":4296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":2251,"num_flush":214,"num_flush_kb":1805,"num_evict":520,"num_evict_kb":64717,"num_promote":576,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"160'1498","reported_seq":2462,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:25.222204+0000","last_change":"2023-08-23T04:07:25.222204+0000","last_active":"2023-08-23T04:07:25.222204+0000","last_peered":"2023-08-23T04:07:25.222204+0000","last_clean":"2023-08-23T04:07:25.222204+0000","last_became_active":"2023-08-23T00:57:56.052052+0000","last_became_peered":"2023-08-23T00:57:56.052052+0000","last_unstale":"2023-08-23T04:07:25.222204+0000","last_undegraded":"2023-08-23T04:07:25.222204+0000","last_fullsized":"2023-08-23T04:07:25.222204+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1498","last_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_deep_scrub":"160'1498","last_deep_scrub_stamp":"2023-08-23T04:07:25.222095+0000","last_clean_scrub_stamp":"2023-08-23T04:07:25.222095+0000","log_size":1498,"ondisk_log_size":1498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123355205,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":665,"num_read_kb":1422,"num_write":1307,"num_write_kb":1005480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"160'4913","reported_seq":11167,"reported_epoch":160,"state":"active+clean+scrubbing+deep","last_fresh":"2023-08-23T04:07:43.514179+0000","last_change":"2023-08-23T04:07:43.434130+0000","last_active":"2023-08-23T04:07:43.514179+0000","last_peered":"2023-08-23T04:07:43.514179+0000","last_clean":"2023-08-23T04:07:43.514179+0000","last_became_active":"2023-08-23T00:58:02.956900+0000","last_became_peered":"2023-08-23T00:58:02.956900+0000","last_unstale":"2023-08-23T04:07:43.514179+0000","last_undegraded":"2023-08-23T04:07:43.514179+0000","last_fullsized":"2023-08-23T04:07:43.514179+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4913,"ondisk_log_size":4913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19809495,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":41,"num_read":12952,"num_read_kb":46670,"num_write":2791,"num_write_kb":1600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1231,"num_flush":212,"num_flush_kb":1106,"num_evict":530,"num_evict_kb":33020,"num_promote":579,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"160'1148","reported_seq":2116,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:06.577297+0000","last_change":"2023-08-23T04:05:06.577297+0000","last_active":"2023-08-23T04:05:06.577297+0000","last_peered":"2023-08-23T04:05:06.577297+0000","last_clean":"2023-08-23T04:05:06.577297+0000","last_became_active":"2023-08-23T00:57:56.047174+0000","last_became_peered":"2023-08-23T00:57:56.047174+0000","last_unstale":"2023-08-23T04:05:06.577297+0000","last_undegraded":"2023-08-23T04:05:06.577297+0000","last_fullsized":"2023-08-23T04:05:06.577297+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1148","last_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_deep_scrub":"160'1148","last_deep_scrub_stamp":"2023-08-23T04:05:06.577158+0000","last_clean_scrub_stamp":"2023-08-23T04:05:06.577158+0000","log_size":1148,"ondisk_log_size":1148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":66261042,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":772,"num_read_kb":600,"num_write":946,"num_write_kb":1187628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":74,"num_omap_keys":8,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"160'3295","reported_seq":8299,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:39.321388+0000","last_change":"2023-08-23T04:07:39.321388+0000","last_active":"2023-08-23T04:07:39.321388+0000","last_peered":"2023-08-23T04:07:39.321388+0000","last_clean":"2023-08-23T04:07:39.321388+0000","last_became_active":"2023-08-23T00:58:02.957226+0000","last_became_peered":"2023-08-23T00:58:02.957226+0000","last_unstale":"2023-08-23T04:07:39.321388+0000","last_undegraded":"2023-08-23T04:07:39.321388+0000","last_fullsized":"2023-08-23T04:07:39.321388+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'3295","last_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_deep_scrub":"160'3295","last_deep_scrub_stamp":"2023-08-23T04:07:39.321141+0000","last_clean_scrub_stamp":"2023-08-23T04:07:39.321141+0000","log_size":3295,"ondisk_log_size":3295,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":31089316,"num_objects":51,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":40,"num_read":10825,"num_read_kb":14163,"num_write":1824,"num_write_kb":1027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":3,"num_bytes_hit_set_archive":676,"num_flush":177,"num_flush_kb":3718,"num_evict":571,"num_evict_kb":19031,"num_promote":619,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"160'1882","reported_seq":2791,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:05:01.621665+0000","last_change":"2023-08-23T04:05:01.621665+0000","last_active":"2023-08-23T04:05:01.621665+0000","last_peered":"2023-08-23T04:05:01.621665+0000","last_clean":"2023-08-23T04:05:01.621665+0000","last_became_active":"2023-08-23T00:57:56.046582+0000","last_became_peered":"2023-08-23T00:57:56.046582+0000","last_unstale":"2023-08-23T04:05:01.621665+0000","last_undegraded":"2023-08-23T04:05:01.621665+0000","last_fullsized":"2023-08-23T04:05:01.621665+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1882","last_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_deep_scrub":"160'1882","last_deep_scrub_stamp":"2023-08-23T04:05:01.621519+0000","last_clean_scrub_stamp":"2023-08-23T04:05:01.621519+0000","log_size":1882,"ondisk_log_size":1882,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":127666733,"num_objects":38,"num_object_clones":1,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":1,"num_read":569,"num_read_kb":497,"num_write":1280,"num_write_kb":1183497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1,"num_omap_keys":1,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"157'4334","reported_seq":11842,"reported_epoch":159,"state":"active+clean","last_fresh":"2023-08-23T02:01:57.373982+0000","last_change":"2023-08-23T01:03:37.990406+0000","last_active":"2023-08-23T02:01:57.373982+0000","last_peered":"2023-08-23T02:01:57.373982+0000","last_clean":"2023-08-23T02:01:57.373982+0000","last_became_active":"2023-08-23T00:58:02.956823+0000","last_became_peered":"2023-08-23T00:58:02.956823+0000","last_unstale":"2023-08-23T02:01:57.373982+0000","last_undegraded":"2023-08-23T02:01:57.373982+0000","last_fullsized":"2023-08-23T02:01:57.373982+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T00:58:01.806372+0000","last_clean_scrub_stamp":"2023-08-23T00:58:01.806372+0000","log_size":4334,"ondisk_log_size":4334,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":52556921,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":33,"num_read":15025,"num_read_kb":30147,"num_write":2243,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":1129,"num_flush":195,"num_flush_kb":33409,"num_evict":631,"num_evict_kb":55392,"num_promote":683,"num_flush_mode_high":0,"num_flush_mode_low":1,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"160'1910","reported_seq":2978,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:32.616115+0000","last_change":"2023-08-23T04:07:32.616115+0000","last_active":"2023-08-23T04:07:32.616115+0000","last_peered":"2023-08-23T04:07:32.616115+0000","last_clean":"2023-08-23T04:07:32.616115+0000","last_became_active":"2023-08-23T00:57:56.043892+0000","last_became_peered":"2023-08-23T00:57:56.043892+0000","last_unstale":"2023-08-23T04:07:32.616115+0000","last_undegraded":"2023-08-23T04:07:32.616115+0000","last_fullsized":"2023-08-23T04:07:32.616115+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"160'1910","last_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_deep_scrub":"160'1910","last_deep_scrub_stamp":"2023-08-23T04:07:32.615903+0000","last_clean_scrub_stamp":"2023-08-23T04:07:32.615903+0000","log_size":1910,"ondisk_log_size":1910,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":184036023,"num_objects":63,"num_object_clones":1,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":1,"num_read":846,"num_read_kb":2030,"num_write":1288,"num_write_kb":1118785,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":182,"num_omap_keys":18,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":162,"reported_epoch":160,"state":"active+clean","last_fresh":"2023-08-23T04:07:26.390419+0000","last_change":"2023-08-23T04:07:26.390419+0000","last_active":"2023-08-23T04:07:26.390419+0000","last_peered":"2023-08-23T04:07:26.390419+0000","last_clean":"2023-08-23T04:07:26.390419+0000","last_became_active":"2023-08-23T00:57:55.042298+0000","last_became_peered":"2023-08-23T00:57:55.042298+0000","last_unstale":"2023-08-23T04:07:26.390419+0000","last_undegraded":"2023-08-23T04:07:26.390419+0000","last_fullsized":"2023-08-23T04:07:26.390419+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-23T04:07:26.390042+0000","last_clean_scrub_stamp":"2023-08-23T04:07:26.390042+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":127702305,"num_objects":225,"num_object_clones":0,"num_object_copies":450,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":110,"num_whiteouts":163,"num_read":60451,"num_read_kb":140735,"num_write":12512,"num_write_kb":8482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":45,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":5287,"num_flush":798,"num_flush_kb":40038,"num_evict":2252,"num_evict_kb":172160,"num_promote":2457,"num_flush_mode_high":0,"num_flush_mode_low":2,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":27,"num_omap_keys":3,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":200482816,"data_stored":200297026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18375,"ondisk_log_size":18375,"up":8,"acting":8,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":1091393691,"num_objects":341,"num_object_clones":4,"num_object_copies":682,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":341,"num_whiteouts":4,"num_read":5282,"num_read_kb":16479,"num_write":9741,"num_write_kb":8867140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1688,"num_omap_keys":169,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":294330368,"data_stored":294097206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12098,"ondisk_log_size":12098,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359740823,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":455320,"kb_used_data":149904,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93916520,"statfs":{"total":96636764160,"available":96170516480,"internally_reserved":0,"allocated":153501696,"data_stored":152710982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:20:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.52500000000000002},"min":{"1min":0.47199999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.59599999999999997,"5min":0.70099999999999996,"15min":0.79700000000000004},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.48099999999999998,"5min":0.44800000000000001,"15min":0.40200000000000002},"max":{"1min":0.65000000000000002,"5min":0.69499999999999995,"15min":0.74199999999999999},"last":0.65800000000000003}]},{"osd":1,"last update":"Wed Aug 23 04:20:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.436},"max":{"1min":0.70199999999999996,"5min":0.73199999999999998,"15min":0.79700000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.59599999999999997,"5min":0.55500000000000005,"15min":0.51100000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.84199999999999997},"last":0.63100000000000001}]}]},{"osd":1,"up_from":8,"seq":34359740820,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":506612,"kb_used_data":205292,"kb_used_omap":0,"kb_used_meta":301312,"kb_avail":93865228,"statfs":{"total":96636764160,"available":96117993472,"internally_reserved":0,"allocated":210219008,"data_stored":209409786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308543488},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Aug 23 04:21:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.52900000000000003},"min":{"1min":0.42099999999999999,"5min":0.376,"15min":0.316},"max":{"1min":0.73499999999999999,"5min":0.82699999999999996,"15min":0.82699999999999996},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.67500000000000004,"15min":0.67400000000000004},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.41399999999999998},"max":{"1min":0.73799999999999999,"5min":0.80200000000000005,"15min":0.88300000000000001},"last":0.64500000000000002}]},{"osd":2,"last update":"Wed Aug 23 04:21:25 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61899999999999999,"15min":0.61299999999999999},"min":{"1min":0.48999999999999999,"5min":0.48299999999999998,"15min":0.40699999999999997},"max":{"1min":0.72299999999999998,"5min":0.80300000000000005,"15min":0.82299999999999995},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59299999999999997,"15min":0.60399999999999998},"min":{"1min":0.496,"5min":0.46600000000000003,"15min":0.38500000000000001},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.95999999999999996},"last":0.72199999999999998}]}]},{"osd":0,"up_from":8,"seq":34359740818,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":437372,"kb_used_data":131956,"kb_used_omap":0,"kb_used_meta":305408,"kb_avail":93934468,"statfs":{"total":96636764160,"available":96188895232,"internally_reserved":0,"allocated":135122944,"data_stored":134366309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":312737792},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,0,256],"upper_bound":33554432},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Aug 23 04:20:48 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52200000000000002,"15min":0.52300000000000002},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.247},"max":{"1min":0.70499999999999996,"5min":0.75600000000000001,"15min":0.75600000000000001},"last":0.502},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.47099999999999997,"5min":0.42699999999999999,"15min":0.33800000000000002},"max":{"1min":0.65000000000000002,"5min":0.73099999999999998,"15min":0.95499999999999996},"last":0.56100000000000005}]},{"osd":2,"last update":"Wed Aug 23 04:21:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60799999999999998,"15min":0.59999999999999998},"min":{"1min":0.51000000000000001,"5min":0.49399999999999999,"15min":0.41699999999999998},"max":{"1min":0.76800000000000002,"5min":0.83399999999999996,"15min":0.93100000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68200000000000005,"15min":0.68000000000000005},"min":{"1min":0.60799999999999998,"5min":0.50600000000000001,"15min":0.34399999999999997},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.72299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":95248384,"data_stored":95183749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":147165184,"data_stored":147048603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51916800,"data_stored":51864854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":38531072,"data_stored":38484945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61710336,"data_stored":61663568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":100241408,"data_stored":100148513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-23T04:21:42.585 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:21:42.585 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-08-23T00:58:01.806372+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=0, tm_min=58, tm_sec=1, tm_wday=2, tm_yday=235, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=23, tm_hour=4, tm_min=0, tm_sec=57, tm_wday=2, tm_yday=235, tm_isdst=0) 2023-08-23T04:21:42.586 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa/tasks/ceph.py", line 1914, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa/tasks/ceph.py", line 1309, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-08-23T04:21:42.594 INFO:teuthology.misc:Shutting down mds daemons... 2023-08-23T04:21:42.595 INFO:teuthology.misc:Shutting down osd daemons... 2023-08-23T04:21:42.596 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-08-23T04:21:42.596 INFO:teuthology.orchestra.run:waiting for 300 2023-08-23T04:21:42.674 INFO:tasks.ceph.osd.0:Stopped 2023-08-23T04:21:42.675 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-08-23T04:21:42.675 INFO:teuthology.orchestra.run:waiting for 300 2023-08-23T04:21:42.746 INFO:tasks.ceph.osd.1:Stopped 2023-08-23T04:21:42.747 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-08-23T04:21:42.747 INFO:teuthology.orchestra.run:waiting for 300 2023-08-23T04:21:42.846 INFO:tasks.ceph.osd.2:Stopped 2023-08-23T04:21:42.846 INFO:teuthology.misc:Shutting down mgr daemons... 2023-08-23T04:21:42.847 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-08-23T04:21:42.847 INFO:teuthology.orchestra.run:waiting for 300 2023-08-23T04:21:42.876 INFO:tasks.ceph.mgr.x:Stopped 2023-08-23T04:21:42.877 INFO:teuthology.misc:Shutting down mon daemons... 2023-08-23T04:21:42.877 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-08-23T04:21:42.878 INFO:teuthology.orchestra.run:waiting for 300 2023-08-23T04:21:42.966 INFO:tasks.ceph.mon.a:Stopped 2023-08-23T04:21:42.966 INFO:tasks.ceph:Checking cluster log for badness... 2023-08-23T04:21:42.967 DEBUG:teuthology.orchestra.run.smithi012:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_NEAR_FULL\)' | egrep -v '\(CACHE_POOL_NO_HIT_SET\)' | head -n 1 2023-08-23T04:21:42.983 INFO:teuthology.orchestra.run.smithi012.stdout:2023-08-23T01:04:31.600109+0000 osd.0 (osd.0) 3 : cluster [WRN] 256 slow requests (by type [ 'reached pg' : 256 ] most affected pool [ 'cache' : 256 ]) 2023-08-23T04:21:42.986 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-08-23T04:21:42.986 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi012.front.sepia.ceph.com 2023-08-23T04:21:42.987 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-08-23T04:21:43.288 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi012.front.sepia.ceph.com 2023-08-23T04:21:43.289 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-08-23T04:21:43.485 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi012.front.sepia.ceph.com 2023-08-23T04:21:43.486 DEBUG:teuthology.orchestra.run.smithi012:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-08-23T04:21:43.659 INFO:tasks.ceph:Archiving mon data... 2023-08-23T04:21:43.662 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-08-22_18:59:01-rbd-pacific-release-distro-default-smithi/7376986/data/mon.a.tgz 2023-08-23T04:21:43.663 DEBUG:teuthology.orchestra.run.smithi012:> mktemp 2023-08-23T04:21:43.672 INFO:teuthology.orchestra.run.smithi012.stdout:/tmp/tmp.5gyVza3Z3w 2023-08-23T04:21:43.673 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.5gyVza3Z3w 2023-08-23T04:21:43.954 DEBUG:teuthology.orchestra.run.smithi012:> sudo chmod 0666 /tmp/tmp.5gyVza3Z3w 2023-08-23T04:21:44.027 DEBUG:teuthology.orchestra.remote:smithi012:/tmp/tmp.5gyVza3Z3w is 585KB 2023-08-23T04:21:44.051 DEBUG:teuthology.orchestra.run.smithi012:> rm -fr /tmp/tmp.5gyVza3Z3w 2023-08-23T04:21:44.058 INFO:tasks.ceph:Cleaning ceph cluster... 2023-08-23T04:21:44.058 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-23T04:21:44.114 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-08-23T04:21:44.115 DEBUG:teuthology.orchestra.run.smithi012:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-23T04:21:44.139 INFO:teuthology.orchestra.run.smithi012.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-23T04:21:44.146 INFO:tasks.ceph:Archiving crash dumps... 2023-08-23T04:21:44.152 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-08-22_18:59:01-rbd-pacific-release-distro-default-smithi/7376986/remote/smithi012/crash 2023-08-23T04:21:44.153 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-23T04:21:44.169 INFO:tasks.ceph:Compressing logs... 2023-08-23T04:21:44.170 DEBUG:teuthology.orchestra.run.smithi012:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-23T04:21:44.232 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74971.log 2023-08-23T04:21:44.233 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73245.log 2023-08-23T04:21:44.233 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37991.log 2023-08-23T04:21:44.233 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74971.log.gz 2023-08-23T04:21:44.234 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53223.log 2023-08-23T04:21:44.234 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73245.log.gz 2023-08-23T04:21:44.235 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35644.log 2023-08-23T04:21:44.235 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37991.log.gz 2023-08-23T04:21:44.236 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43287.log 2023-08-23T04:21:44.236 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53223.log.gz 2023-08-23T04:21:44.237 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42087.log 2023-08-23T04:21:44.237 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35644.log.gz 2023-08-23T04:21:44.237 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49363.log 2023-08-23T04:21:44.237 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43287.log.gz 2023-08-23T04:21:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49383.log 2023-08-23T04:21:44.239 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42087.log.gz 2023-08-23T04:21:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49363.log.gz 2023-08-23T04:21:44.239 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53751.log 2023-08-23T04:21:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49383.log.gz 2023-08-23T04:21:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40002.log 2023-08-23T04:21:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53751.log.gz 2023-08-23T04:21:44.240 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38529.log 2023-08-23T04:21:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52495.log 2023-08-23T04:21:44.245 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40002.log: /var/log/ceph/ceph-client.admin.38529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38529.log.gz 2023-08-23T04:21:44.245 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40002.log.gz 2023-08-23T04:21:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71113.log 2023-08-23T04:21:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56801.log 2023-08-23T04:21:44.246 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52495.log: /var/log/ceph/ceph-client.admin.71113.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71113.log.gz 2023-08-23T04:21:44.246 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52495.log.gz 2023-08-23T04:21:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51847.log 2023-08-23T04:21:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56801.log.gz 2023-08-23T04:21:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54864.log 2023-08-23T04:21:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75934.log 2023-08-23T04:21:44.247 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51847.log: /var/log/ceph/ceph-client.admin.54864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51847.log.gz 2023-08-23T04:21:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44504.log 2023-08-23T04:21:44.248 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54864.log.gz 2023-08-23T04:21:44.248 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75934.log.gz 2023-08-23T04:21:44.249 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67664.log 2023-08-23T04:21:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44504.log.gz 2023-08-23T04:21:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77241.log 2023-08-23T04:21:44.261 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67664.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67664.log.gz 2023-08-23T04:21:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65989.log 2023-08-23T04:21:44.262 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67470.log 2023-08-23T04:21:44.263 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77241.log.gz 2023-08-23T04:21:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60592.log 2023-08-23T04:21:44.263 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65989.log.gz 2023-08-23T04:21:44.263 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74382.log 2023-08-23T04:21:44.264 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67470.log.gz 2023-08-23T04:21:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60592.log.gz 2023-08-23T04:21:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70978.log 2023-08-23T04:21:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74382.log.gz 2023-08-23T04:21:44.264 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36850.log 2023-08-23T04:21:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42879.log 2023-08-23T04:21:44.265 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70978.log.gz 2023-08-23T04:21:44.265 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36441.log 0.0% 2023-08-23T04:21:44.265 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36850.log.gz 2023-08-23T04:21:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42879.log.gz 2023-08-23T04:21:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51352.log 2023-08-23T04:21:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36441.log.gz 2023-08-23T04:21:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53420.log 2023-08-23T04:21:44.266 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61189.log 2023-08-23T04:21:44.267 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51352.log.gz 2023-08-23T04:21:44.267 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62435.log 2023-08-23T04:21:44.267 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53420.log.gz 2023-08-23T04:21:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61189.log.gz 2023-08-23T04:21:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33142.log 2023-08-23T04:21:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62435.log.gz 2023-08-23T04:21:44.268 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76470.log 2023-08-23T04:21:44.269 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49490.log 2023-08-23T04:21:44.269 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33142.log: /var/log/ceph/ceph-client.admin.76470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76470.log.gz 2023-08-23T04:21:44.269 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33142.log.gz 2023-08-23T04:21:44.269 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65246.log 2023-08-23T04:21:44.269 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49490.log.gz 2023-08-23T04:21:44.269 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41107.log 2023-08-23T04:21:44.270 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75870.log 2023-08-23T04:21:44.270 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65246.log.gz 2023-08-23T04:21:44.270 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44525.log 2023-08-23T04:21:44.271 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41107.log.gz 2023-08-23T04:21:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37344.log 2023-08-23T04:21:44.271 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75870.log.gz 2023-08-23T04:21:44.272 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76510.log 2023-08-23T04:21:44.272 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44525.log.gz 2023-08-23T04:21:44.273 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37344.log.gz 2023-08-23T04:21:44.273 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39883.log 2023-08-23T04:21:44.278 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76510.log.gz 2023-08-23T04:21:44.279 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34016.log 2023-08-23T04:21:44.279 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74704.log 2023-08-23T04:21:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39883.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39883.log.gz 2023-08-23T04:21:44.280 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51167.log 2023-08-23T04:21:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34016.log.gz 2023-08-23T04:21:44.281 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74704.log.gz 2023-08-23T04:21:44.282 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52366.log 2023-08-23T04:21:44.282 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72851.log 2023-08-23T04:21:44.282 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51167.log.gz 2023-08-23T04:21:44.296 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.52366.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.71740.log 2023-08-23T04:21:44.297 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52366.log.gz 2023-08-23T04:21:44.297 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45743.log 2023-08-23T04:21:44.297 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72851.log.gz 2023-08-23T04:21:44.297 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71740.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.71740.log.gz-5 2023-08-23T04:21:44.297 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.39390.log 2023-08-23T04:21:44.298 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70488.log 2023-08-23T04:21:44.298 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45743.log.gz 2023-08-23T04:21:44.298 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44798.log 2023-08-23T04:21:44.298 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39390.log: /var/log/ceph/ceph-client.admin.70488.log: 0.0% 1.2% -- replaced with /var/log/ceph/ceph-client.admin.70488.log.gz 2023-08-23T04:21:44.299 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39390.log.gz 2023-08-23T04:21:44.299 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52905.log 2023-08-23T04:21:44.299 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37855.log 2023-08-23T04:21:44.299 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44798.log: /var/log/ceph/ceph-client.admin.52905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44798.log.gz 2023-08-23T04:21:44.299 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52905.log.gz 2023-08-23T04:21:44.300 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46654.log 2023-08-23T04:21:44.300 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67642.log 2023-08-23T04:21:44.300 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37855.log: 1.2%/var/log/ceph/ceph-client.admin.46654.log: -- replaced with /var/log/ceph/ceph-client.admin.37855.log.gz 2023-08-23T04:21:44.300 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65910.log 2023-08-23T04:21:44.300 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46654.log.gz 2023-08-23T04:21:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67642.log.gz 2023-08-23T04:21:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64470.log 2023-08-23T04:21:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65910.log.gz 2023-08-23T04:21:44.301 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45533.log 2023-08-23T04:21:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60057.log 2023-08-23T04:21:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64470.log.gz 2023-08-23T04:21:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45533.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.45533.log.gz 2023-08-23T04:21:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63110.log 2023-08-23T04:21:44.302 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48076.log 2023-08-23T04:21:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60057.log.gz 2023-08-23T04:21:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36012.log 2023-08-23T04:21:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63110.log.gz 2023-08-23T04:21:44.303 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.48076.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47753.log 2023-08-23T04:21:44.303 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48076.log.gz 2023-08-23T04:21:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33507.log 2023-08-23T04:21:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36012.log.gz 2023-08-23T04:21:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65160.log 2023-08-23T04:21:44.304 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47753.log.gz 2023-08-23T04:21:44.304 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51933.log 2023-08-23T04:21:44.305 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33507.log.gz 2023-08-23T04:21:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35681.log 2023-08-23T04:21:44.305 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65160.log.gz 2023-08-23T04:21:44.305 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41047.log 2023-08-23T04:21:44.305 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51933.log.gz 2023-08-23T04:21:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35681.log: 5.3% -- replaced with /var/log/ceph/ceph-client.admin.35681.log.gz 2023-08-23T04:21:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47818.log 2023-08-23T04:21:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62155.log 2023-08-23T04:21:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41047.log: 0.0%/var/log/ceph/ceph-client.admin.47818.log: -- replaced with /var/log/ceph/ceph-client.admin.41047.log.gz 2023-08-23T04:21:44.306 INFO:teuthology.orchestra.run.smithi012.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47818.log.gz-5 2023-08-23T04:21:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.37430.log 2023-08-23T04:21:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41387.log 2023-08-23T04:21:44.307 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62155.log.gz 2023-08-23T04:21:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37430.log.gz 2023-08-23T04:21:44.307 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70213.log 2023-08-23T04:21:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78440.log 2023-08-23T04:21:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41387.log.gz 2023-08-23T04:21:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77327.log 2023-08-23T04:21:44.308 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70213.log.gz 2023-08-23T04:21:44.308 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.78440.log: --verbose -- /var/log/ceph/ceph-client.admin.57819.log 2023-08-23T04:21:44.309 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78440.log.gz 2023-08-23T04:21:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55034.log 2023-08-23T04:21:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77327.log.gz 2023-08-23T04:21:44.309 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57819.log: /var/log/ceph/ceph-client.admin.33924.log 2023-08-23T04:21:44.309 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57819.log.gz 2023-08-23T04:21:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64644.log 2023-08-23T04:21:44.310 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55034.log.gz 2023-08-23T04:21:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47256.log 2023-08-23T04:21:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33924.log: 0.0%/var/log/ceph/ceph-client.admin.64644.log: -- replaced with /var/log/ceph/ceph-client.admin.33924.log.gz 2023-08-23T04:21:44.310 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43950.log 2023-08-23T04:21:44.310 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64644.log.gz 2023-08-23T04:21:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.47256.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.76854.log 2023-08-23T04:21:44.311 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47256.log.gz 2023-08-23T04:21:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64687.log 2023-08-23T04:21:44.311 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43950.log.gz 2023-08-23T04:21:44.311 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43168.log 2023-08-23T04:21:44.312 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76854.log.gz 2023-08-23T04:21:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69440.log 2023-08-23T04:21:44.312 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64687.log.gz 2023-08-23T04:21:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67062.log 2023-08-23T04:21:44.312 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43168.log.gz 2023-08-23T04:21:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.69440.log: --verbose -- /var/log/ceph/ceph-client.admin.68965.log 2023-08-23T04:21:44.313 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69440.log.gz 2023-08-23T04:21:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68929.log 2023-08-23T04:21:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67062.log.gz 2023-08-23T04:21:44.313 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73973.log 2023-08-23T04:21:44.314 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68965.log.gz 2023-08-23T04:21:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74016.log 2023-08-23T04:21:44.314 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68929.log.gz 2023-08-23T04:21:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66113.log 2023-08-23T04:21:44.314 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73973.log.gz 2023-08-23T04:21:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67083.log 2023-08-23T04:21:44.315 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74016.log.gz 2023-08-23T04:21:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40155.log 2023-08-23T04:21:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66113.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.66113.log.gz-5 2023-08-23T04:21:44.315 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.55768.log 2023-08-23T04:21:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67083.log: /var/log/ceph/ceph-client.admin.40155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67083.log.gz 2023-08-23T04:21:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56951.log 2023-08-23T04:21:44.316 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40155.log.gz 2023-08-23T04:21:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72937.log 2023-08-23T04:21:44.316 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55768.log.gz 2023-08-23T04:21:44.317 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66911.log 2023-08-23T04:21:44.317 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56951.log.gz 2023-08-23T04:21:44.317 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32479.log 2023-08-23T04:21:44.317 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72937.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72937.log.gz 2023-08-23T04:21:44.317 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66911.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.66911.log.gz-5 2023-08-23T04:21:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.36807.log 2023-08-23T04:21:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33206.log 2023-08-23T04:21:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32479.log.gz 2023-08-23T04:21:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61595.log 2023-08-23T04:21:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36807.log.gz 2023-08-23T04:21:44.318 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74124.log 2023-08-23T04:21:44.319 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33206.log.gz 2023-08-23T04:21:44.319 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76875.log 2023-08-23T04:21:44.319 INFO:teuthology.orchestra.run.smithi012.stderr: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.61595.log.gz 2023-08-23T04:21:44.319 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60675.log 2023-08-23T04:21:44.319 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74124.log.gz 2023-08-23T04:21:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40104.log 2023-08-23T04:21:44.320 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76875.log.gz 2023-08-23T04:21:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60675.log.gz 2023-08-23T04:21:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34175.log 2023-08-23T04:21:44.320 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72349.log 2023-08-23T04:21:44.321 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40104.log.gz 2023-08-23T04:21:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-08-23T04:21:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34175.log: /var/log/ceph/ceph-client.admin.72349.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34175.log.gz 2023-08-23T04:21:44.321 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72349.log.gz 2023-08-23T04:21:44.321 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34537.log 2023-08-23T04:21:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38744.log 2023-08-23T04:21:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70759.log 2023-08-23T04:21:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34537.log: /var/log/ceph/ceph-client.admin.38744.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.34537.log.gz--verbose 2023-08-23T04:21:44.322 INFO:teuthology.orchestra.run.smithi012.stderr:-- /var/log/ceph/ceph-client.admin.49592.log 2023-08-23T04:21:44.322 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38744.log.gz 2023-08-23T04:21:44.323 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46762.log 2023-08-23T04:21:44.323 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70759.log.gz 2023-08-23T04:21:44.323 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50445.log 2023-08-23T04:21:44.348 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49592.log: /var/log/ceph/ceph-client.admin.46762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49592.log.gz 2023-08-23T04:21:44.349 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46762.log.gz 2023-08-23T04:21:44.349 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79228.log 2023-08-23T04:21:44.349 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53794.log 2023-08-23T04:21:44.349 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50445.log.gz 2023-08-23T04:21:44.350 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69699.log 2023-08-23T04:21:44.350 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79228.log.gz 2023-08-23T04:21:44.350 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75784.log 2023-08-23T04:21:44.350 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53794.log: /var/log/ceph/ceph-client.admin.69699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60511.log 2023-08-23T04:21:44.350 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53794.log.gz 2023-08-23T04:21:44.351 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69699.log.gz 2023-08-23T04:21:44.351 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59735.log 2023-08-23T04:21:44.351 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75784.log.gz 2023-08-23T04:21:44.351 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57304.log 2023-08-23T04:21:44.351 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60511.log.gz 2023-08-23T04:21:44.352 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63216.log 2023-08-23T04:21:44.352 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59735.log.gz 2023-08-23T04:21:44.352 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67040.log 2023-08-23T04:21:44.352 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57304.log.gz 2023-08-23T04:21:44.352 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68999.log 2023-08-23T04:21:44.353 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63216.log: /var/log/ceph/ceph-client.admin.67040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61918.log 2023-08-23T04:21:44.353 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67040.log.gz 2023-08-23T04:21:44.353 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63216.log.gz 2023-08-23T04:21:44.353 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45869.log 2023-08-23T04:21:44.353 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68999.log.gz 2023-08-23T04:21:44.354 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62757.log 2023-08-23T04:21:44.354 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61918.log.gz 2023-08-23T04:21:44.354 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.45869.log: -- /var/log/ceph/ceph-client.admin.63005.log 2023-08-23T04:21:44.354 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45869.log.gz 2023-08-23T04:21:44.354 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73715.log 2023-08-23T04:21:44.355 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62757.log.gz 2023-08-23T04:21:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39305.log 2023-08-23T04:21:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63005.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.63005.log.gz-5 2023-08-23T04:21:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.60801.log 2023-08-23T04:21:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73715.log.gz 2023-08-23T04:21:44.355 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39016.log 2023-08-23T04:21:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39305.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39305.log.gz 2023-08-23T04:21:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54909.log 2023-08-23T04:21:44.356 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60801.log.gz 2023-08-23T04:21:44.356 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60491.log 2023-08-23T04:21:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39016.log: /var/log/ceph/ceph-client.admin.54909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76918.log 2023-08-23T04:21:44.357 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54909.log.gz 2023-08-23T04:21:44.357 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39016.log.gz 2023-08-23T04:21:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60571.log 2023-08-23T04:21:44.357 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60491.log.gz 2023-08-23T04:21:44.357 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39186.log 2023-08-23T04:21:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76918.log.gz 2023-08-23T04:21:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73286.log 2023-08-23T04:21:44.358 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60571.log.gz 2023-08-23T04:21:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32695.log 2023-08-23T04:21:44.358 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39186.log: 1.2%/var/log/ceph/ceph-client.admin.73286.log: -- replaced with /var/log/ceph/ceph-client.admin.39186.log.gz 2023-08-23T04:21:44.359 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73286.log.gz 2023-08-23T04:21:44.359 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33658.log 2023-08-23T04:21:44.359 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42327.log 2023-08-23T04:21:44.359 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32695.log.gz 2023-08-23T04:21:44.359 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71940.log 2023-08-23T04:21:44.360 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33658.log.gz 2023-08-23T04:21:44.360 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46547.log 2023-08-23T04:21:44.360 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42327.log.gz 2023-08-23T04:21:44.360 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50507.log 2023-08-23T04:21:44.360 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71940.log.gz 2023-08-23T04:21:44.361 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65717.log 2023-08-23T04:21:44.361 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46547.log.gz 2023-08-23T04:21:44.361 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57583.log 2023-08-23T04:21:44.361 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50507.log.gz 2023-08-23T04:21:44.361 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62413.log 2023-08-23T04:21:44.362 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65717.log.gz 2023-08-23T04:21:44.362 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68095.log 2023-08-23T04:21:44.362 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57583.log.gz 2023-08-23T04:21:44.362 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77439.log 2023-08-23T04:21:44.362 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62413.log.gz 2023-08-23T04:21:44.363 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40206.log 2023-08-23T04:21:44.363 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68095.log.gz 2023-08-23T04:21:44.363 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65833.log 2023-08-23T04:21:44.363 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77439.log: /var/log/ceph/ceph-client.admin.40206.log: 11.8% -- replaced with /var/log/ceph/ceph-client.admin.77439.log.gz 2023-08-23T04:21:44.363 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43032.log 2023-08-23T04:21:44.363 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40206.log.gz 2023-08-23T04:21:44.364 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.65833.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.63557.log 2023-08-23T04:21:44.364 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65833.log.gz 2023-08-23T04:21:44.364 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43032.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.65268.log -- replaced with /var/log/ceph/ceph-client.admin.43032.log.gz 2023-08-23T04:21:44.364 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:21:44.364 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58717.log 2023-08-23T04:21:44.365 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63557.log.gz 2023-08-23T04:21:44.365 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47277.log 2023-08-23T04:21:44.365 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65268.log.gz 2023-08-23T04:21:44.365 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61509.log 2023-08-23T04:21:44.365 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58717.log.gz 2023-08-23T04:21:44.366 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47277.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.47277.log.gz 2023-08-23T04:21:44.366 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.72769.log 2023-08-23T04:21:44.366 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72585.log 2023-08-23T04:21:44.366 INFO:teuthology.orchestra.run.smithi012.stderr: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.61509.log.gz 2023-08-23T04:21:44.366 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52431.log 2023-08-23T04:21:44.367 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72769.log.gz 2023-08-23T04:21:44.367 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72585.log.gz 2023-08-23T04:21:44.367 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39169.log 2023-08-23T04:21:44.367 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39373.log 2023-08-23T04:21:44.367 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52431.log.gz 2023-08-23T04:21:44.368 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74081.log 2023-08-23T04:21:44.368 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39169.log.gz 2023-08-23T04:21:44.368 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37735.log 2023-08-23T04:21:44.368 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39373.log.gz 2023-08-23T04:21:44.368 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43304.log 2023-08-23T04:21:44.369 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74081.log.gz 2023-08-23T04:21:44.369 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58757.log 2023-08-23T04:21:44.369 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37735.log.gz 2023-08-23T04:21:44.369 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78712.log 2023-08-23T04:21:44.369 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43304.log.gz 2023-08-23T04:21:44.370 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72499.log 2023-08-23T04:21:44.370 INFO:teuthology.orchestra.run.smithi012.stderr: 53.5% -- replaced with /var/log/ceph/ceph-client.admin.58757.log.gz 2023-08-23T04:21:44.370 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64537.log 2023-08-23T04:21:44.370 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78712.log: 0.0%/var/log/ceph/ceph-client.admin.72499.log: -- replaced with /var/log/ceph/ceph-client.admin.78712.log.gz 2023-08-23T04:21:44.370 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72499.log.gz 2023-08-23T04:21:44.371 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48762.log 2023-08-23T04:21:44.371 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79201.log 2023-08-23T04:21:44.371 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64537.log: /var/log/ceph/ceph-client.admin.48762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64537.log.gz 2023-08-23T04:21:44.371 INFO:teuthology.orchestra.run.smithi012.stderr: 18.5% -- replaced with /var/log/ceph/ceph-client.admin.48762.log.gz 2023-08-23T04:21:44.371 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41087.log 2023-08-23T04:21:44.372 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47904.log 2023-08-23T04:21:44.372 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79201.log.gz 2023-08-23T04:21:44.372 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53686.log 2023-08-23T04:21:44.372 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41087.log.gz 2023-08-23T04:21:44.372 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76811.log 2023-08-23T04:21:44.373 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47904.log.gz 2023-08-23T04:21:44.373 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66653.log 2023-08-23T04:21:44.373 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53686.log.gz 2023-08-23T04:21:44.373 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34983.log 2023-08-23T04:21:44.373 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76703.log 2023-08-23T04:21:44.373 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76811.log.gz 2023-08-23T04:21:44.374 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66653.log.gz 2023-08-23T04:21:44.374 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58013.log 2023-08-23T04:21:44.374 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34983.log.gz 2023-08-23T04:21:44.374 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73180.log 2023-08-23T04:21:44.374 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76703.log.gz 2023-08-23T04:21:44.375 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64328.log 2023-08-23T04:21:44.375 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58013.log.gz 2023-08-23T04:21:44.375 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42624.log 2023-08-23T04:21:44.375 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73180.log.gz 2023-08-23T04:21:44.375 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65225.log 2023-08-23T04:21:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64328.log.gz 2023-08-23T04:21:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52019.log 2023-08-23T04:21:44.376 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42624.log.gz 2023-08-23T04:21:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44103.log 2023-08-23T04:21:44.376 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65225.log.gz 2023-08-23T04:21:44.377 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71645.log 2023-08-23T04:21:44.377 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52019.log.gz 2023-08-23T04:21:44.377 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46163.log 2023-08-23T04:21:44.377 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44103.log.gz 2023-08-23T04:21:44.377 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54052.log 2023-08-23T04:21:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71645.log: 53.5% -- replaced with /var/log/ceph/ceph-client.admin.71645.log.gz 2023-08-23T04:21:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72005.log 2023-08-23T04:21:44.378 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46163.log.gz 2023-08-23T04:21:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.54052.log: -- /var/log/ceph/ceph-client.admin.62881.log 2023-08-23T04:21:44.378 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54052.log.gz 2023-08-23T04:21:44.378 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47297.log 2023-08-23T04:21:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72005.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.72005.log.gz-5 --verbose 2023-08-23T04:21:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:-- /var/log/ceph/ceph-client.admin.43457.log 2023-08-23T04:21:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62881.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.62881.log.gz-5 2023-08-23T04:21:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.40053.log 2023-08-23T04:21:44.379 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47297.log.gz 2023-08-23T04:21:44.380 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41267.log 2023-08-23T04:21:44.380 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43457.log.gz 2023-08-23T04:21:44.380 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49530.log 2023-08-23T04:21:44.380 INFO:teuthology.orchestra.run.smithi012.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.40053.log.gz 2023-08-23T04:21:44.380 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59778.log 2023-08-23T04:21:44.381 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41267.log.gz 2023-08-23T04:21:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40019.log 2023-08-23T04:21:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49530.log: 56.1%/var/log/ceph/ceph-client.admin.59778.log: -- replaced with /var/log/ceph/ceph-client.admin.49530.log.gz 2023-08-23T04:21:44.381 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69040.log 2023-08-23T04:21:44.381 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59778.log.gz 2023-08-23T04:21:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51524.log 2023-08-23T04:21:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40019.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.40019.log.gz 2023-08-23T04:21:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71605.log 2023-08-23T04:21:44.382 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69040.log.gz 2023-08-23T04:21:44.382 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35702.log 2023-08-23T04:21:44.383 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51524.log.gz 2023-08-23T04:21:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33550.log 2023-08-23T04:21:44.383 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71605.log.gz 2023-08-23T04:21:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49966.log 2023-08-23T04:21:44.383 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35702.log.gz 2023-08-23T04:21:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35627.log 2023-08-23T04:21:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33550.log.gz 2023-08-23T04:21:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77869.log 2023-08-23T04:21:44.384 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49966.log.gz 2023-08-23T04:21:44.384 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34289.log 2023-08-23T04:21:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35627.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.35627.log.gz 2023-08-23T04:21:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72749.log 2023-08-23T04:21:44.385 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77869.log.gz 2023-08-23T04:21:44.385 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34289.log: /var/log/ceph/ceph-client.admin.51395.log 2023-08-23T04:21:44.385 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34289.log.gz 2023-08-23T04:21:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66890.log 2023-08-23T04:21:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72749.log.gz 2023-08-23T04:21:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70960.log 2023-08-23T04:21:44.386 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51395.log.gz 2023-08-23T04:21:44.386 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45302.log 2023-08-23T04:21:44.386 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66890.log.gz 2023-08-23T04:21:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70129.log 2023-08-23T04:21:44.387 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70960.log.gz 2023-08-23T04:21:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57031.log 2023-08-23T04:21:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45302.log.gz 2023-08-23T04:21:44.387 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50585.log 2023-08-23T04:21:44.388 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70129.log.gz 2023-08-23T04:21:44.388 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75762.log 2023-08-23T04:21:44.388 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57031.log.gz 2023-08-23T04:21:44.388 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54953.log 2023-08-23T04:21:44.388 INFO:teuthology.orchestra.run.smithi012.stderr: 22.5% -- replaced with /var/log/ceph/ceph-client.admin.50585.log.gz 2023-08-23T04:21:44.389 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56693.log 2023-08-23T04:21:44.389 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75762.log.gz 2023-08-23T04:21:44.389 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41787.log 2023-08-23T04:21:44.389 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54953.log.gz 2023-08-23T04:21:44.389 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60531.log 2023-08-23T04:21:44.390 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56693.log.gz 2023-08-23T04:21:44.390 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44651.log 2023-08-23T04:21:44.390 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41787.log.gz 2023-08-23T04:21:44.390 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45134.log 2023-08-23T04:21:44.390 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60531.log.gz 2023-08-23T04:21:44.391 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56349.log 2023-08-23T04:21:44.391 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44651.log.gz 2023-08-23T04:21:44.391 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29666.log 2023-08-23T04:21:44.391 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45134.log.gz 2023-08-23T04:21:44.391 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56349.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56349.log.gz 2023-08-23T04:21:44.391 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72069.log 2023-08-23T04:21:44.392 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29783.log 2023-08-23T04:21:44.392 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.29666.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.29666.log.gz 2023-08-23T04:21:44.392 INFO:teuthology.orchestra.run.smithi012.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.35743.log 2023-08-23T04:21:44.392 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72069.log.gz 2023-08-23T04:21:44.392 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42862.log 2023-08-23T04:21:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.29783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29783.log.gz 2023-08-23T04:21:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47581.log 2023-08-23T04:21:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35743.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35743.log.gz 2023-08-23T04:21:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67492.log 2023-08-23T04:21:44.393 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42862.log.gz 2023-08-23T04:21:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56069.log 2023-08-23T04:21:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47581.log.gz 2023-08-23T04:21:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68055.log 2023-08-23T04:21:44.394 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59307.log 2023-08-23T04:21:44.394 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67492.log.gz 2023-08-23T04:21:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56069.log.gz 2023-08-23T04:21:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38292.log 2023-08-23T04:21:44.395 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68055.log.gz 2023-08-23T04:21:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49737.log 2023-08-23T04:21:44.395 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59307.log: 56.7% -- replaced with /var/log/ceph/ceph-client.admin.59307.log.gz 2023-08-23T04:21:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38292.log: /var/log/ceph/ceph-client.admin.48205.log 2023-08-23T04:21:44.396 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38292.log.gz 2023-08-23T04:21:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52882.log 2023-08-23T04:21:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49737.log.gz 2023-08-23T04:21:44.396 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46934.log 2023-08-23T04:21:44.397 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48205.log.gz 2023-08-23T04:21:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55118.log 2023-08-23T04:21:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52882.log.gz 2023-08-23T04:21:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76214.log 2023-08-23T04:21:44.397 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46934.log.gz 2023-08-23T04:21:44.398 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43236.log 2023-08-23T04:21:44.398 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55118.log.gz 2023-08-23T04:21:44.398 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75404.log 2023-08-23T04:21:44.398 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76214.log.gz 2023-08-23T04:21:44.398 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61380.log 2023-08-23T04:21:44.399 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43236.log.gz 2023-08-23T04:21:44.399 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75404.log: /var/log/ceph/ceph-client.admin.71385.log 2023-08-23T04:21:44.399 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75404.log.gz 2023-08-23T04:21:44.399 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51146.log 2023-08-23T04:21:44.399 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61380.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.61380.log.gz 2023-08-23T04:21:44.400 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49323.log 2023-08-23T04:21:44.400 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71385.log.gz 2023-08-23T04:21:44.400 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79255.log 2023-08-23T04:21:44.400 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51146.log.gz 2023-08-23T04:21:44.548 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71505.log 2023-08-23T04:21:44.548 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60861.log 2023-08-23T04:21:44.549 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49323.log.gz 2023-08-23T04:21:44.549 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79255.log: /var/log/ceph/ceph-client.admin.71505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79255.log.gzgzip 2023-08-23T04:21:44.549 INFO:teuthology.orchestra.run.smithi012.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.60267.log 2023-08-23T04:21:44.549 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71505.log.gz 2023-08-23T04:21:44.550 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32932.log 2023-08-23T04:21:44.550 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60861.log.gz 2023-08-23T04:21:44.550 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35969.log 2023-08-23T04:21:44.550 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60267.log.gz 2023-08-23T04:21:44.550 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59262.log 2023-08-23T04:21:44.551 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32932.log.gz 2023-08-23T04:21:44.551 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76768.log 2023-08-23T04:21:44.551 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35969.log.gz 2023-08-23T04:21:44.551 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52689.log 2023-08-23T04:21:44.551 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59262.log: 54.5% -- replaced with /var/log/ceph/ceph-client.admin.59262.log.gz 2023-08-23T04:21:44.552 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50664.log 2023-08-23T04:21:44.552 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76768.log.gz 2023-08-23T04:21:44.552 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53399.log 2023-08-23T04:21:44.552 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52689.log.gz 2023-08-23T04:21:44.553 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50664.log: /var/log/ceph/ceph-client.admin.47646.log 2023-08-23T04:21:44.553 INFO:teuthology.orchestra.run.smithi012.stderr: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.50664.log.gz 2023-08-23T04:21:44.553 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.53399.log: --verbose -- /var/log/ceph/ceph-client.admin.36141.log 2023-08-23T04:21:44.553 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53399.log.gz 2023-08-23T04:21:44.554 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65679.log 2023-08-23T04:21:44.554 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47646.log.gz 2023-08-23T04:21:44.554 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55875.log 2023-08-23T04:21:44.554 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36141.log.gz 2023-08-23T04:21:44.554 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44252.log 2023-08-23T04:21:44.555 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65679.log.gz 2023-08-23T04:21:44.555 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36592.log 2023-08-23T04:21:44.555 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55875.log.gz 2023-08-23T04:21:44.555 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57158.log 2023-08-23T04:21:44.555 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40487.log 2023-08-23T04:21:44.556 INFO:teuthology.orchestra.run.smithi012.stderr: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.44252.log.gz 2023-08-23T04:21:44.556 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79719.log 2023-08-23T04:21:44.556 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36592.log.gz 2023-08-23T04:21:44.556 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57158.log.gz 2023-08-23T04:21:44.557 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40444.log 2023-08-23T04:21:44.557 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40487.log.gz 2023-08-23T04:21:44.557 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.79719.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42964.log 2023-08-23T04:21:44.557 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79719.log.gz 2023-08-23T04:21:44.557 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35434.log 2023-08-23T04:21:44.558 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40444.log.gz 2023-08-23T04:21:44.558 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76983.log 2023-08-23T04:21:44.558 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42964.log.gz 2023-08-23T04:21:44.558 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52452.log 2023-08-23T04:21:44.558 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35434.log.gz 2023-08-23T04:21:44.559 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72091.log 2023-08-23T04:21:44.559 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76983.log.gz 2023-08-23T04:21:44.559 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53514.log 2023-08-23T04:21:44.559 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52452.log.gz 2023-08-23T04:21:44.559 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50268.log 2023-08-23T04:21:44.560 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72091.log.gz 2023-08-23T04:21:44.560 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60187.log 2023-08-23T04:21:44.560 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53514.log.gz 2023-08-23T04:21:44.560 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67169.log 2023-08-23T04:21:44.560 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50268.log: 56.3% -- replaced with /var/log/ceph/ceph-client.admin.50268.log.gz 2023-08-23T04:21:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46955.log 2023-08-23T04:21:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60187.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60187.log.gz 2023-08-23T04:21:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41307.log 2023-08-23T04:21:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67169.log.gz 2023-08-23T04:21:44.561 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35922.log 2023-08-23T04:21:44.562 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46955.log.gz 2023-08-23T04:21:44.562 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54736.log 2023-08-23T04:21:44.562 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41307.log.gz 2023-08-23T04:21:44.562 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72241.log 2023-08-23T04:21:44.562 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35922.log.gz 2023-08-23T04:21:44.563 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43355.log 2023-08-23T04:21:44.563 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54736.log.gz 2023-08-23T04:21:44.563 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46697.log 2023-08-23T04:21:44.563 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72241.log.gz 2023-08-23T04:21:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71526.log 2023-08-23T04:21:44.564 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43355.log.gz 2023-08-23T04:21:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61982.log 2023-08-23T04:21:44.564 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46697.log.gz 2023-08-23T04:21:44.564 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67234.log 2023-08-23T04:21:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71526.log.gz 2023-08-23T04:21:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61982.log: /var/log/ceph/ceph-client.admin.68383.log 2023-08-23T04:21:44.565 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61982.log.gz 2023-08-23T04:21:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59584.log 2023-08-23T04:21:44.565 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67234.log.gz 2023-08-23T04:21:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76534.log 2023-08-23T04:21:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68383.log.gz 2023-08-23T04:21:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51782.log 2023-08-23T04:21:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59584.log.gz 2023-08-23T04:21:44.566 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78386.log 2023-08-23T04:21:44.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76534.log.gz 2023-08-23T04:21:44.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55225.log 2023-08-23T04:21:44.567 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51782.log.gz 2023-08-23T04:21:44.567 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67513.log 2023-08-23T04:21:44.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78386.log.gz 2023-08-23T04:21:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.55225.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40291.log 2023-08-23T04:21:44.568 INFO:teuthology.orchestra.run.smithi012.stderr: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.55225.log.gz 2023-08-23T04:21:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53622.log 2023-08-23T04:21:44.568 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67513.log.gz 2023-08-23T04:21:44.568 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68691.log 2023-08-23T04:21:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40291.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40291.log.gz 2023-08-23T04:21:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71722.log 2023-08-23T04:21:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53622.log.gz 2023-08-23T04:21:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57240.log 2023-08-23T04:21:44.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68691.log.gz 2023-08-23T04:21:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78576.log 2023-08-23T04:21:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71722.log.gz 2023-08-23T04:21:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57240.log: /var/log/ceph/ceph-client.admin.42930.log 2023-08-23T04:21:44.570 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57240.log.gz 2023-08-23T04:21:44.570 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51005.log 2023-08-23T04:21:44.571 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78576.log.gz 2023-08-23T04:21:44.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59391.log 2023-08-23T04:21:44.571 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42930.log.gz 2023-08-23T04:21:44.571 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43151.log 2023-08-23T04:21:44.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51005.log.gz 2023-08-23T04:21:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.59391.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66276.log 2023-08-23T04:21:44.572 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59391.log.gz 2023-08-23T04:21:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55618.log 2023-08-23T04:21:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43151.log.gz 2023-08-23T04:21:44.572 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40376.log 2023-08-23T04:21:44.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66276.log.gz 2023-08-23T04:21:44.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63321.log 2023-08-23T04:21:44.573 INFO:teuthology.orchestra.run.smithi012.stderr: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.55618.log.gz 2023-08-23T04:21:44.573 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.40376.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57518.log 2023-08-23T04:21:44.573 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40376.log.gz 2023-08-23T04:21:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70880.log 2023-08-23T04:21:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63321.log.gz 2023-08-23T04:21:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57518.log: /var/log/ceph/ceph-client.admin.44735.log 2023-08-23T04:21:44.574 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57518.log.gz 2023-08-23T04:21:44.574 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38249.log 2023-08-23T04:21:44.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70880.log.gz 2023-08-23T04:21:44.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64902.log 2023-08-23T04:21:44.575 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44735.log.gz 2023-08-23T04:21:44.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78413.log 2023-08-23T04:21:44.575 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38249.log.gz 2023-08-23T04:21:44.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49161.log 2023-08-23T04:21:44.576 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64902.log.gz 2023-08-23T04:21:44.576 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33961.log 2023-08-23T04:21:44.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78413.log.gz 2023-08-23T04:21:44.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73522.log 2023-08-23T04:21:44.577 INFO:teuthology.orchestra.run.smithi012.stderr: 58.5% -- replaced with /var/log/ceph/ceph-client.admin.49161.log.gz 2023-08-23T04:21:44.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57798.log 2023-08-23T04:21:44.577 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33961.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33961.log.gz 2023-08-23T04:21:44.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41687.log 2023-08-23T04:21:44.577 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73522.log.gz 2023-08-23T04:21:44.578 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41227.log 2023-08-23T04:21:44.578 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57798.log.gz 2023-08-23T04:21:44.578 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43440.log 2023-08-23T04:21:44.578 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41687.log.gz 2023-08-23T04:21:44.579 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73307.log 2023-08-23T04:21:44.579 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41227.log.gz 2023-08-23T04:21:44.579 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52062.log 2023-08-23T04:21:44.579 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43440.log.gz 2023-08-23T04:21:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43015.log 2023-08-23T04:21:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73307.log.gz 2023-08-23T04:21:44.580 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47143.log 2023-08-23T04:21:44.580 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52062.log.gz 2023-08-23T04:21:44.581 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36785.log 2023-08-23T04:21:44.581 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43015.log.gz 2023-08-23T04:21:44.581 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61316.log 2023-08-23T04:21:44.581 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47143.log.gz 2023-08-23T04:21:44.582 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60167.log 2023-08-23T04:21:44.582 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36785.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36785.log.gz 2023-08-23T04:21:44.582 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41727.log 2023-08-23T04:21:44.582 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61316.log.gz 2023-08-23T04:21:44.582 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.60167.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64490.log 2023-08-23T04:21:44.583 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60167.log.gz 2023-08-23T04:21:44.583 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46226.log 2023-08-23T04:21:44.583 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41727.log.gz 2023-08-23T04:21:44.583 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42709.log 2023-08-23T04:21:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64490.log.gz 2023-08-23T04:21:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70799.log 2023-08-23T04:21:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46226.log: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.46226.log.gz 2023-08-23T04:21:44.584 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66029.log 2023-08-23T04:21:44.585 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42709.log.gz 2023-08-23T04:21:44.585 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76235.log 2023-08-23T04:21:44.585 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70799.log.gz 2023-08-23T04:21:44.585 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39033.log 2023-08-23T04:21:44.586 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66029.log.gz 2023-08-23T04:21:44.586 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44861.log 2023-08-23T04:21:44.586 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76235.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76235.log.gz 2023-08-23T04:21:44.586 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77738.log 2023-08-23T04:21:44.586 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39033.log.gz 2023-08-23T04:21:44.587 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37699.log 2023-08-23T04:21:44.587 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44861.log.gz 2023-08-23T04:21:44.587 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77899.log 2023-08-23T04:21:44.588 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77738.log.gz 2023-08-23T04:21:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38658.log 2023-08-23T04:21:44.588 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37699.log.gz 2023-08-23T04:21:44.588 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39849.log 2023-08-23T04:21:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77899.log.gz 2023-08-23T04:21:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34347.log 2023-08-23T04:21:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38658.log.gz 2023-08-23T04:21:44.589 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45050.log 2023-08-23T04:21:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39849.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39849.log.gz 2023-08-23T04:21:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78522.log 2023-08-23T04:21:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34347.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34347.log.gz 2023-08-23T04:21:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35722.log 2023-08-23T04:21:44.590 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45050.log.gz 2023-08-23T04:21:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76832.log 2023-08-23T04:21:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78522.log.gz 2023-08-23T04:21:44.591 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.35722.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39594.log 2023-08-23T04:21:44.591 INFO:teuthology.orchestra.run.smithi012.stderr: 5.3% -- replaced with /var/log/ceph/ceph-client.admin.35722.log.gz 2023-08-23T04:21:44.592 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74188.log 2023-08-23T04:21:44.592 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76832.log.gz 2023-08-23T04:21:44.592 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62177.log 2023-08-23T04:21:44.592 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47775.log 2023-08-23T04:21:44.593 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39594.log.gz 2023-08-23T04:21:44.593 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74188.log: /var/log/ceph/ceph-client.admin.62177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37043.log 2023-08-23T04:21:44.593 INFO:teuthology.orchestra.run.smithi012.stderr: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.74188.log.gz 2023-08-23T04:21:44.593 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62177.log.gz 2023-08-23T04:21:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61875.log 2023-08-23T04:21:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47775.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.47775.log.gz 2023-08-23T04:21:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.45281.log 2023-08-23T04:21:44.594 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37043.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.37043.log.gz-5 2023-08-23T04:21:44.595 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.41847.log 2023-08-23T04:21:44.595 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61875.log.gz 2023-08-23T04:21:44.595 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67105.log 2023-08-23T04:21:44.595 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45281.log.gz 2023-08-23T04:21:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36527.log 2023-08-23T04:21:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41847.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.41847.log.gz-5 2023-08-23T04:21:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.64310.log 2023-08-23T04:21:44.596 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67105.log.gz 2023-08-23T04:21:44.597 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71076.log 2023-08-23T04:21:44.597 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36527.log.gz 2023-08-23T04:21:44.597 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45218.log 2023-08-23T04:21:44.597 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64310.log.gz 2023-08-23T04:21:44.597 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34669.log 2023-08-23T04:21:44.598 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71076.log.gz 2023-08-23T04:21:44.598 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63729.log 2023-08-23T04:21:44.598 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45218.log.gz 2023-08-23T04:21:44.598 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38163.log 2023-08-23T04:21:44.599 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34669.log.gz 2023-08-23T04:21:44.599 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35155.log 2023-08-23T04:21:44.599 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63729.log.gz 2023-08-23T04:21:44.599 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61274.log 2023-08-23T04:21:44.600 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38163.log.gz 2023-08-23T04:21:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56715.log 2023-08-23T04:21:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35155.log.gz 2023-08-23T04:21:44.600 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47105.log 2023-08-23T04:21:44.601 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61274.log.gz 2023-08-23T04:21:44.601 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63880.log 2023-08-23T04:21:44.601 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56715.log.gz 2023-08-23T04:21:44.601 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.47105.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62263.log 2023-08-23T04:21:44.602 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47105.log.gz 2023-08-23T04:21:44.602 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54577.log 2023-08-23T04:21:44.602 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63880.log.gz 2023-08-23T04:21:44.602 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35090.log 2023-08-23T04:21:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62263.log.gz 2023-08-23T04:21:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79611.log 2023-08-23T04:21:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54577.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54577.log.gz 2023-08-23T04:21:44.603 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53536.log 2023-08-23T04:21:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35090.log.gz 2023-08-23T04:21:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50988.log 2023-08-23T04:21:44.604 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79611.log.gz 2023-08-23T04:21:44.604 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46719.log 2023-08-23T04:21:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53536.log.gz 2023-08-23T04:21:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68403.log 2023-08-23T04:21:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50988.log.gz 2023-08-23T04:21:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39611.log 2023-08-23T04:21:44.605 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46719.log.gz 2023-08-23T04:21:44.606 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42692.log 2023-08-23T04:21:44.606 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68403.log.gz 2023-08-23T04:21:44.606 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68266.log 2023-08-23T04:21:44.606 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39611.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39611.log.gz 2023-08-23T04:21:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62901.log 2023-08-23T04:21:44.607 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42692.log.gz 2023-08-23T04:21:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34112.log 2023-08-23T04:21:44.607 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50606.log 2023-08-23T04:21:44.608 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68266.log.gz 2023-08-23T04:21:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56242.log 2023-08-23T04:21:44.608 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62901.log.gz 2023-08-23T04:21:44.608 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34112.log.gz 2023-08-23T04:21:44.609 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58737.log 2023-08-23T04:21:44.609 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50606.log: 0.0%/var/log/ceph/ceph-client.admin.56242.log: -- replaced with /var/log/ceph/ceph-client.admin.50606.log.gz 2023-08-23T04:21:44.609 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52977.log 2023-08-23T04:21:44.609 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56242.log.gz 2023-08-23T04:21:44.610 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69323.log 2023-08-23T04:21:44.610 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58737.log.gz 2023-08-23T04:21:44.610 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38378.log 2023-08-23T04:21:44.610 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52977.log.gz 2023-08-23T04:21:44.611 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78901.log 2023-08-23T04:21:44.611 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69323.log.gz 2023-08-23T04:21:44.611 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55940.log 2023-08-23T04:21:44.611 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38378.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.39084.log 2023-08-23T04:21:44.612 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38378.log.gz 2023-08-23T04:21:44.612 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65950.log 2023-08-23T04:21:44.612 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78901.log.gz 2023-08-23T04:21:44.612 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55940.log: /var/log/ceph/ceph-client.admin.39084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55940.log.gz 2023-08-23T04:21:44.613 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39084.log.gz 2023-08-23T04:21:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48858.log 2023-08-23T04:21:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50826.log 2023-08-23T04:21:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65950.log.gz 2023-08-23T04:21:44.613 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65074.log 2023-08-23T04:21:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48858.log.gz 2023-08-23T04:21:44.614 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39458.log 2023-08-23T04:21:44.614 INFO:teuthology.orchestra.run.smithi012.stderr: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.50826.log.gz 2023-08-23T04:21:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76639.log 2023-08-23T04:21:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65074.log.gz 2023-08-23T04:21:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59369.log 2023-08-23T04:21:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39458.log: /var/log/ceph/ceph-client.admin.76639.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39458.log.gz 2023-08-23T04:21:44.615 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76321.log 2023-08-23T04:21:44.616 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76639.log.gz 2023-08-23T04:21:44.616 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60881.log 2023-08-23T04:21:44.616 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59369.log.gz 2023-08-23T04:21:44.616 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51460.log 2023-08-23T04:21:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76321.log.gz 2023-08-23T04:21:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48097.log 2023-08-23T04:21:44.617 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60881.log.gz 2023-08-23T04:21:44.617 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68169.log 2023-08-23T04:21:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51460.log.gz 2023-08-23T04:21:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75612.log 2023-08-23T04:21:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48097.log: 0.0%/var/log/ceph/ceph-client.admin.68169.log: -- replaced with /var/log/ceph/ceph-client.admin.48097.log.gz 2023-08-23T04:21:44.618 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71802.log 2023-08-23T04:21:44.619 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68169.log.gz 2023-08-23T04:21:44.619 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40867.log 2023-08-23T04:21:44.619 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75612.log.gz 2023-08-23T04:21:44.619 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34423.log 2023-08-23T04:21:44.620 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71802.log.gz 2023-08-23T04:21:44.620 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41427.log 2023-08-23T04:21:44.620 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40867.log.gz 2023-08-23T04:21:44.620 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39067.log 2023-08-23T04:21:44.621 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34423.log.gz 2023-08-23T04:21:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35824.log 2023-08-23T04:21:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41427.log.gz 2023-08-23T04:21:44.621 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.39067.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.62650.log 2023-08-23T04:21:44.622 INFO:teuthology.orchestra.run.smithi012.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39067.log.gz 2023-08-23T04:21:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68519.log 2023-08-23T04:21:44.622 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35824.log.gz 2023-08-23T04:21:44.622 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72809.log 2023-08-23T04:21:44.622 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62650.log.gz 2023-08-23T04:21:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54536.log 2023-08-23T04:21:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68519.log: 53.5% -- replaced with /var/log/ceph/ceph-client.admin.68519.log.gz 2023-08-23T04:21:44.623 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70699.log 2023-08-23T04:21:44.623 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72809.log.gz 2023-08-23T04:21:44.624 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34461.log 2023-08-23T04:21:44.624 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54536.log.gz 2023-08-23T04:21:44.624 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43202.log 2023-08-23T04:21:44.624 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70699.log.gz 2023-08-23T04:21:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56736.log 2023-08-23T04:21:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34461.log.gz 2023-08-23T04:21:44.625 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37908.log 2023-08-23T04:21:44.625 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43202.log.gz 2023-08-23T04:21:44.626 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39509.log 2023-08-23T04:21:44.626 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56736.log.gz 2023-08-23T04:21:44.626 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53189.log 2023-08-23T04:21:44.626 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37908.log.gz 2023-08-23T04:21:44.627 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72370.log 2023-08-23T04:21:44.627 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39509.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39509.log.gz 2023-08-23T04:21:44.627 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68851.log 2023-08-23T04:21:44.627 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53189.log.gz 2023-08-23T04:21:44.627 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51675.log 2023-08-23T04:21:44.628 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72370.log.gz 2023-08-23T04:21:44.628 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62607.log 2023-08-23T04:21:44.628 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68851.log.gz 2023-08-23T04:21:44.628 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48921.log 2023-08-23T04:21:44.629 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51675.log.gz 2023-08-23T04:21:44.629 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36399.log /var/log/ceph/ceph-client.admin.62607.log: 2023-08-23T04:21:44.629 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62607.log.gz 2023-08-23T04:21:44.629 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56564.log 2023-08-23T04:21:44.630 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48921.log: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.48921.log.gz 2023-08-23T04:21:44.630 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55098.log 2023-08-23T04:21:44.630 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36399.log.gz 2023-08-23T04:21:44.630 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53708.log 2023-08-23T04:21:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56564.log.gz 2023-08-23T04:21:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40359.log 2023-08-23T04:21:44.631 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55098.log.gz 2023-08-23T04:21:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59627.log 2023-08-23T04:21:44.631 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53708.log.gz 2023-08-23T04:21:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33996.log 2023-08-23T04:21:44.632 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40359.log.gz 2023-08-23T04:21:44.632 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55162.log 2023-08-23T04:21:44.633 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59627.log.gz 2023-08-23T04:21:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70642.log 2023-08-23T04:21:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33996.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.33996.log.gz 2023-08-23T04:21:44.633 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45974.log 2023-08-23T04:21:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55162.log.gz 2023-08-23T04:21:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68230.log 2023-08-23T04:21:44.634 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70642.log.gz 2023-08-23T04:21:44.634 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37717.log 2023-08-23T04:21:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45974.log.gz 2023-08-23T04:21:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68638.log 2023-08-23T04:21:44.635 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68230.log.gz 2023-08-23T04:21:44.635 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37717.log: /var/log/ceph/ceph-client.admin.55704.log 2023-08-23T04:21:44.635 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37717.log.gz 2023-08-23T04:21:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34233.log 2023-08-23T04:21:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68638.log.gz 2023-08-23T04:21:44.636 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35112.log 2023-08-23T04:21:44.636 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55704.log.gz 2023-08-23T04:21:44.637 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66610.log 2023-08-23T04:21:44.637 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34233.log.gz 2023-08-23T04:21:44.637 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56176.log 2023-08-23T04:21:44.637 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35112.log.gz 2023-08-23T04:21:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69583.log 2023-08-23T04:21:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66610.log.gz 2023-08-23T04:21:44.638 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77842.log 2023-08-23T04:21:44.638 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56176.log.gz 2023-08-23T04:21:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65618.log 2023-08-23T04:21:44.639 INFO:teuthology.orchestra.run.smithi012.stderr: 53.3% -- replaced with /var/log/ceph/ceph-client.admin.69583.log.gz 2023-08-23T04:21:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64135.log 2023-08-23T04:21:44.639 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75098.log 2023-08-23T04:21:44.640 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77842.log.gz 2023-08-23T04:21:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65618.log.gz 2023-08-23T04:21:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73543.log 2023-08-23T04:21:44.640 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64135.log.gz 2023-08-23T04:21:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42726.log 2023-08-23T04:21:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75098.log.gz 2023-08-23T04:21:44.641 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68152.log 2023-08-23T04:21:44.641 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73543.log.gz 2023-08-23T04:21:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77495.log 2023-08-23T04:21:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42726.log.gz 2023-08-23T04:21:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79638.log 2023-08-23T04:21:44.642 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68152.log.gz 2023-08-23T04:21:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.77495.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.67298.log 2023-08-23T04:21:44.643 INFO:teuthology.orchestra.run.smithi012.stderr: 60.7% -- replaced with /var/log/ceph/ceph-client.admin.77495.log.gz 2023-08-23T04:21:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65117.log 2023-08-23T04:21:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79638.log.gz 2023-08-23T04:21:44.643 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42387.log 2023-08-23T04:21:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67298.log.gz 2023-08-23T04:21:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71425.log 2023-08-23T04:21:44.644 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65117.log.gz 2023-08-23T04:21:44.644 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.42387.log: -- /var/log/ceph/ceph-client.admin.55661.log 2023-08-23T04:21:44.645 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42387.log.gz 2023-08-23T04:21:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44018.log 2023-08-23T04:21:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71425.log.gz 2023-08-23T04:21:44.645 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36335.log 2023-08-23T04:21:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55661.log.gz 2023-08-23T04:21:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61939.log 2023-08-23T04:21:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44018.log.gz 2023-08-23T04:21:44.646 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75180.log 2023-08-23T04:21:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36335.log.gz 2023-08-23T04:21:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37409.log 2023-08-23T04:21:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61939.log.gz 2023-08-23T04:21:44.647 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52909.log 2023-08-23T04:21:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75180.log: 12.0% -- replaced with /var/log/ceph/ceph-client.admin.75180.log.gz 2023-08-23T04:21:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36184.log 2023-08-23T04:21:44.648 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37409.log.gz 2023-08-23T04:21:44.648 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41547.log 2023-08-23T04:21:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42307.log 2023-08-23T04:21:44.649 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0%/var/log/ceph/ceph-client.admin.36184.log: -- replaced with /var/log/ceph/ceph-client.admin.52909.log.gz 2023-08-23T04:21:44.649 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36184.log.gz 2023-08-23T04:21:44.649 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.41547.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.65327.log 2023-08-23T04:21:44.650 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41547.log.gz 2023-08-23T04:21:44.650 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.42307.log: --verbose -- /var/log/ceph/ceph-client.admin.48393.log 2023-08-23T04:21:44.650 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42307.log.gz 2023-08-23T04:21:44.650 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50288.log 2023-08-23T04:21:44.650 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65327.log.gz 2023-08-23T04:21:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39815.log 2023-08-23T04:21:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41187.log 2023-08-23T04:21:44.651 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48393.log.gz 2023-08-23T04:21:44.651 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50288.log: 22.9% -- replaced with /var/log/ceph/ceph-client.admin.50288.log.gz 2023-08-23T04:21:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.39815.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53815.log 2023-08-23T04:21:44.652 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39815.log.gz 2023-08-23T04:21:44.652 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44609.log 2023-08-23T04:21:44.652 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41187.log.gz 2023-08-23T04:21:44.653 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51997.log 2023-08-23T04:21:44.653 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36549.log 2023-08-23T04:21:44.653 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53815.log.gz 2023-08-23T04:21:44.653 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44609.log: /var/log/ceph/ceph-client.admin.51997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37280.log 2023-08-23T04:21:44.654 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44609.log.gz 2023-08-23T04:21:44.654 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51997.log.gz 2023-08-23T04:21:44.654 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40767.log 2023-08-23T04:21:44.654 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36549.log.gz 2023-08-23T04:21:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76449.log 2023-08-23T04:21:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57755.log 2023-08-23T04:21:44.655 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37280.log.gz 2023-08-23T04:21:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40767.log.gz 2023-08-23T04:21:44.655 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44378.log 2023-08-23T04:21:44.656 INFO:teuthology.orchestra.run.smithi012.stderr: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.76449.log.gz 2023-08-23T04:21:44.656 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62923.log 2023-08-23T04:21:44.656 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57755.log.gz 2023-08-23T04:21:44.657 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34731.log 2023-08-23T04:21:44.657 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44378.log.gz 2023-08-23T04:21:44.657 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65600.log 2023-08-23T04:21:44.657 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62923.log.gz 2023-08-23T04:21:44.657 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77069.log 2023-08-23T04:21:44.658 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34731.log.gz 2023-08-23T04:21:44.658 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78657.log 2023-08-23T04:21:44.658 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65600.log.gz 2023-08-23T04:21:44.658 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41507.log 2023-08-23T04:21:44.659 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77069.log.gz 2023-08-23T04:21:44.659 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70371.log 2023-08-23T04:21:44.659 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78657.log.gz 2023-08-23T04:21:44.659 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51567.log 2023-08-23T04:21:44.660 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41507.log.gz 2023-08-23T04:21:44.660 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40070.log 2023-08-23T04:21:44.660 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70371.log.gz 2023-08-23T04:21:44.660 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57199.log 2023-08-23T04:21:44.661 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51567.log.gz 2023-08-23T04:21:44.661 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49121.log 2023-08-23T04:21:44.661 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40070.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40070.log.gz 2023-08-23T04:21:44.661 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63278.log 2023-08-23T04:21:44.662 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57199.log.gz 2023-08-23T04:21:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37452.log 2023-08-23T04:21:44.662 INFO:teuthology.orchestra.run.smithi012.stderr: 10.2% -- replaced with /var/log/ceph/ceph-client.admin.49121.log.gz 2023-08-23T04:21:44.662 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50528.log /var/log/ceph/ceph-client.admin.63278.log: 2023-08-23T04:21:44.663 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63278.log.gz 2023-08-23T04:21:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51610.log 2023-08-23T04:21:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37452.log.gz 2023-08-23T04:21:44.663 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.50528.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.79530.log 2023-08-23T04:21:44.663 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50528.log.gz 2023-08-23T04:21:44.664 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70525.log 2023-08-23T04:21:44.664 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51610.log.gz 2023-08-23T04:21:44.664 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64190.log 2023-08-23T04:21:44.664 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79530.log.gz 2023-08-23T04:21:44.665 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77790.log 2023-08-23T04:21:44.665 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70525.log.gz 2023-08-23T04:21:44.665 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40240.log 2023-08-23T04:21:44.665 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64190.log.gz 2023-08-23T04:21:44.666 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53172.log 2023-08-23T04:21:44.666 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77790.log.gz 2023-08-23T04:21:44.666 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70919.log 2023-08-23T04:21:44.666 INFO:teuthology.orchestra.run.smithi012.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.40240.log.gz 2023-08-23T04:21:44.666 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45176.log 2023-08-23T04:21:44.667 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53172.log.gz 2023-08-23T04:21:44.667 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48290.log 2023-08-23T04:21:44.667 INFO:teuthology.orchestra.run.smithi012.stderr: 56.9% -- replaced with /var/log/ceph/ceph-client.admin.70919.log.gz 2023-08-23T04:21:44.667 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62943.log 2023-08-23T04:21:44.667 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45176.log.gz 2023-08-23T04:21:44.668 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48290.log: /var/log/ceph/ceph-client.admin.62542.log 2023-08-23T04:21:44.668 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48290.log.gz 2023-08-23T04:21:44.668 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38142.log 2023-08-23T04:21:44.668 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62943.log.gz 2023-08-23T04:21:44.669 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41007.log 2023-08-23T04:21:44.669 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62542.log.gz 2023-08-23T04:21:44.669 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53066.log 2023-08-23T04:21:44.669 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38142.log.gz 2023-08-23T04:21:44.669 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43899.log 2023-08-23T04:21:44.670 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41007.log.gz 2023-08-23T04:21:44.670 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65538.log 2023-08-23T04:21:44.670 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53066.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53066.log.gz 2023-08-23T04:21:44.670 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73119.log 2023-08-23T04:21:44.670 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43899.log.gz 2023-08-23T04:21:44.671 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51209.log 2023-08-23T04:21:44.671 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65538.log.gz 2023-08-23T04:21:44.671 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50090.log 2023-08-23T04:21:44.671 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48248.log 2023-08-23T04:21:44.671 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73119.log.gz 2023-08-23T04:21:44.672 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54994.log 2023-08-23T04:21:44.672 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51209.log.gz 2023-08-23T04:21:44.672 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50090.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.50090.log.gz 2023-08-23T04:21:44.672 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43508.log 2023-08-23T04:21:44.672 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48248.log.gz 2023-08-23T04:21:44.673 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.54994.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.75327.log 2023-08-23T04:21:44.673 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54994.log.gz 2023-08-23T04:21:44.673 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50247.log 2023-08-23T04:21:44.673 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43508.log.gz 2023-08-23T04:21:44.673 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38931.log 2023-08-23T04:21:44.674 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75327.log.gz 2023-08-23T04:21:44.674 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.50247.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.61295.log 2023-08-23T04:21:44.674 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50247.log.gz 2023-08-23T04:21:44.674 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68420.log 2023-08-23T04:21:44.674 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38931.log.gz 2023-08-23T04:21:44.674 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37022.log 2023-08-23T04:21:44.675 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61295.log.gz 2023-08-23T04:21:44.675 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44171.log 2023-08-23T04:21:44.675 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68420.log.gz 2023-08-23T04:21:44.675 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74854.log 2023-08-23T04:21:44.675 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37022.log.gz 2023-08-23T04:21:44.676 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70428.log 2023-08-23T04:21:44.676 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44171.log.gz 2023-08-23T04:21:44.676 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48140.log 2023-08-23T04:21:44.676 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74854.log.gz 2023-08-23T04:21:44.677 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44987.log 2023-08-23T04:21:44.677 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70428.log.gz 2023-08-23T04:21:44.677 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52960.log 2023-08-23T04:21:44.677 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48140.log.gz 2023-08-23T04:21:44.677 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45701.log 2023-08-23T04:21:44.678 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44987.log.gz 2023-08-23T04:21:44.678 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.52960.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54435.log 2023-08-23T04:21:44.678 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52960.log.gz 2023-08-23T04:21:44.678 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52323.log 2023-08-23T04:21:44.678 INFO:teuthology.orchestra.run.smithi012.stderr: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.45701.log.gz 2023-08-23T04:21:44.679 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37151.log 2023-08-23T04:21:44.679 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54435.log.gz 2023-08-23T04:21:44.679 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55267.log 2023-08-23T04:21:44.679 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52323.log.gz 2023-08-23T04:21:44.679 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72413.log 2023-08-23T04:21:44.680 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37151.log.gz 2023-08-23T04:21:44.680 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49715.log 2023-08-23T04:21:44.680 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55267.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.55267.log.gz 2023-08-23T04:21:44.680 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55811.log 2023-08-23T04:21:44.680 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72413.log.gz 2023-08-23T04:21:44.681 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66847.log 2023-08-23T04:21:44.681 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49715.log.gz 2023-08-23T04:21:44.681 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50486.log 2023-08-23T04:21:44.681 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55811.log.gz 2023-08-23T04:21:44.681 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57219.log 2023-08-23T04:21:44.682 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66847.log.gz 2023-08-23T04:21:44.682 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49469.log 2023-08-23T04:21:44.682 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50486.log.gz 2023-08-23T04:21:44.682 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59412.log 2023-08-23T04:21:44.682 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57219.log.gz 2023-08-23T04:21:44.683 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37194.log 2023-08-23T04:21:44.683 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49469.log.gz 2023-08-23T04:21:44.683 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51804.log 2023-08-23T04:21:44.683 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59412.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59412.log.gz 2023-08-23T04:21:44.683 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.37194.log: --verbose -- /var/log/ceph/ceph-client.admin.41767.log 2023-08-23T04:21:44.684 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37194.log.gz 2023-08-23T04:21:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55141.log 2023-08-23T04:21:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51804.log.gz 2023-08-23T04:21:44.684 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54202.log 2023-08-23T04:21:44.684 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41767.log.gz 2023-08-23T04:21:44.685 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53880.log 2023-08-23T04:21:44.685 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55141.log.gz 2023-08-23T04:21:44.685 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49902.log 2023-08-23T04:21:44.685 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54202.log.gz 2023-08-23T04:21:44.685 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53880.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.53880.log.gz 2023-08-23T04:21:44.686 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78116.log 2023-08-23T04:21:44.686 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.49902.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.76405.log 2023-08-23T04:21:44.686 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49902.log.gz 2023-08-23T04:21:44.686 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75977.log 2023-08-23T04:21:44.686 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78116.log.gz 2023-08-23T04:21:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.76405.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.74511.log 2023-08-23T04:21:44.687 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76405.log.gz 2023-08-23T04:21:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66051.log 2023-08-23T04:21:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75977.log.gz 2023-08-23T04:21:44.687 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66377.log 2023-08-23T04:21:44.688 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74511.log.gz 2023-08-23T04:21:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.66051.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.72134.log 2023-08-23T04:21:44.688 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66051.log.gz 2023-08-23T04:21:44.688 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41067.log 2023-08-23T04:21:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66377.log: /var/log/ceph/ceph-client.admin.72134.log: 11.6% -- replaced with /var/log/ceph/ceph-client.admin.66377.log.gz 2023-08-23T04:21:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46461.log 2023-08-23T04:21:44.689 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72134.log.gz 2023-08-23T04:21:44.689 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35804.log 2023-08-23T04:21:44.689 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41067.log.gz 2023-08-23T04:21:44.690 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76660.log 2023-08-23T04:21:44.690 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46461.log.gz 2023-08-23T04:21:44.690 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38914.log 2023-08-23T04:21:44.690 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35804.log.gz 2023-08-23T04:21:44.690 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57117.log 2023-08-23T04:21:44.691 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76660.log.gz 2023-08-23T04:21:44.691 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55183.log 2023-08-23T04:21:44.691 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38914.log: /var/log/ceph/ceph-client.admin.57117.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38914.log.gz 2023-08-23T04:21:44.691 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45827.log 2023-08-23T04:21:44.692 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57117.log.gz 2023-08-23T04:21:44.692 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39220.log 2023-08-23T04:21:44.692 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55183.log.gz 2023-08-23T04:21:44.692 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77369.log 2023-08-23T04:21:44.692 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45827.log.gz 2023-08-23T04:21:44.693 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73139.log 2023-08-23T04:21:44.693 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39220.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39220.log.gz 2023-08-23T04:21:44.693 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69480.log 2023-08-23T04:21:44.693 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77369.log.gz 2023-08-23T04:21:44.693 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51954.log 2023-08-23T04:21:44.694 INFO:teuthology.orchestra.run.smithi012.stderr: 53.9% -- replaced with /var/log/ceph/ceph-client.admin.73139.log.gz 2023-08-23T04:21:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47316.log 2023-08-23T04:21:44.694 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69480.log.gz 2023-08-23T04:21:44.694 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.51954.log: --verbose -- /var/log/ceph/ceph-client.admin.42167.log 2023-08-23T04:21:44.694 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51954.log.gz 2023-08-23T04:21:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78630.log 2023-08-23T04:21:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47316.log.gz 2023-08-23T04:21:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36936.log 2023-08-23T04:21:44.695 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42167.log.gz 2023-08-23T04:21:44.695 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39322.log 2023-08-23T04:21:44.696 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78630.log.gz 2023-08-23T04:21:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62521.log 2023-08-23T04:21:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36936.log.gz 2023-08-23T04:21:44.696 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62837.log 2023-08-23T04:21:44.697 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39322.log.gz 2023-08-23T04:21:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65754.log 2023-08-23T04:21:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62521.log.gz 2023-08-23T04:21:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42427.log 2023-08-23T04:21:44.697 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62837.log.gz 2023-08-23T04:21:44.698 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64350.log 2023-08-23T04:21:44.698 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65754.log.gz 2023-08-23T04:21:44.698 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75553.log 2023-08-23T04:21:44.698 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42427.log.gz 2023-08-23T04:21:44.699 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40427.log 2023-08-23T04:21:44.699 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64350.log.gz 2023-08-23T04:21:44.699 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79828.log 2023-08-23T04:21:44.699 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75553.log.gz 2023-08-23T04:21:44.699 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46247.log 2023-08-23T04:21:44.700 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40427.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40427.log.gz 2023-08-23T04:21:44.700 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34118.log 2023-08-23T04:21:44.700 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79828.log.gz 2023-08-23T04:21:44.700 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67793.log 2023-08-23T04:21:44.701 INFO:teuthology.orchestra.run.smithi012.stderr: 22.9% -- replaced with /var/log/ceph/ceph-client.admin.46247.log.gz 2023-08-23T04:21:44.701 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52345.log 2023-08-23T04:21:44.701 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34118.log.gz 2023-08-23T04:21:44.701 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69856.log 2023-08-23T04:21:44.701 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67793.log.gz 2023-08-23T04:21:44.702 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32828.log 2023-08-23T04:21:44.702 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52345.log.gz 2023-08-23T04:21:44.702 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47839.log 2023-08-23T04:21:44.702 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69856.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69856.log.gz 2023-08-23T04:21:44.703 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69199.log 2023-08-23T04:21:44.703 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32828.log.gz 2023-08-23T04:21:44.703 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58673.log 2023-08-23T04:21:44.703 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47839.log.gz 2023-08-23T04:21:44.704 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57346.log 2023-08-23T04:21:44.704 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69199.log.gz 2023-08-23T04:21:44.704 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54181.log 2023-08-23T04:21:44.704 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58673.log.gz 2023-08-23T04:21:44.705 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45575.log 2023-08-23T04:21:44.705 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57346.log.gz 2023-08-23T04:21:44.705 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54181.log: /var/log/ceph/ceph-client.admin.46310.log 2023-08-23T04:21:44.705 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54181.log.gz 2023-08-23T04:21:44.705 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70009.log 2023-08-23T04:21:44.706 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45575.log.gz 2023-08-23T04:21:44.706 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41667.log 2023-08-23T04:21:44.706 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46310.log.gz 2023-08-23T04:21:44.706 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52130.log 2023-08-23T04:21:44.706 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70009.log.gz 2023-08-23T04:21:44.707 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65700.log 2023-08-23T04:21:44.707 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41667.log.gz 2023-08-23T04:21:44.707 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41467.log 2023-08-23T04:21:44.707 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52130.log.gz 2023-08-23T04:21:44.708 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43372.log 2023-08-23T04:21:44.708 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65700.log.gz 2023-08-23T04:21:44.708 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58056.log 2023-08-23T04:21:44.708 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41467.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41467.log.gz 2023-08-23T04:21:44.709 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54009.log 2023-08-23T04:21:44.709 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43372.log.gz 2023-08-23T04:21:44.709 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75424.log 2023-08-23T04:21:44.709 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58056.log.gz 2023-08-23T04:21:44.710 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40527.log 2023-08-23T04:21:44.710 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54009.log.gz 2023-08-23T04:21:44.710 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61088.log 2023-08-23T04:21:44.710 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75424.log.gz 2023-08-23T04:21:44.710 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37473.log 2023-08-23T04:21:44.711 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40527.log.gz 2023-08-23T04:21:44.711 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64068.log /var/log/ceph/ceph-client.admin.61088.log: 2023-08-23T04:21:44.711 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61088.log.gz 2023-08-23T04:21:44.711 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63665.log 2023-08-23T04:21:44.711 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37473.log.gz 2023-08-23T04:21:44.712 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77198.log 2023-08-23T04:21:44.712 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64068.log.gz 2023-08-23T04:21:44.712 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44693.log 2023-08-23T04:21:44.712 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63665.log: /var/log/ceph/ceph-client.admin.77198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63665.log.gz 2023-08-23T04:21:44.713 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55054.log 2023-08-23T04:21:44.713 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77198.log.gz 2023-08-23T04:21:44.713 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44672.log 2023-08-23T04:21:44.713 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44693.log.gz 2023-08-23T04:21:44.714 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69605.log 2023-08-23T04:21:44.714 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55054.log.gz 2023-08-23T04:21:44.714 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37215.log 2023-08-23T04:21:44.714 INFO:teuthology.orchestra.run.smithi012.stderr: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.44672.log.gz 2023-08-23T04:21:44.714 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54374.log 2023-08-23T04:21:44.715 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69605.log.gz 2023-08-23T04:21:44.715 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53579.log 2023-08-23T04:21:44.715 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37215.log.gz 2023-08-23T04:21:44.715 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64580.log 2023-08-23T04:21:44.715 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54374.log.gz 2023-08-23T04:21:44.716 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39492.log 2023-08-23T04:21:44.716 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53579.log.gz 2023-08-23T04:21:44.716 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68791.log 2023-08-23T04:21:44.716 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64580.log.gz 2023-08-23T04:21:44.716 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46268.log 2023-08-23T04:21:44.717 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39492.log.gz 2023-08-23T04:21:44.717 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38701.log 2023-08-23T04:21:44.717 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68791.log.gz 2023-08-23T04:21:44.717 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48962.log 2023-08-23T04:21:44.717 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46268.log: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.46268.log.gz 2023-08-23T04:21:44.718 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.38701.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.51246.log 2023-08-23T04:21:44.718 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38701.log.gz 2023-08-23T04:21:44.718 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71919.log 2023-08-23T04:21:44.718 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48962.log: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.48962.log.gz 2023-08-23T04:21:44.718 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64859.log 2023-08-23T04:21:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51246.log.gz 2023-08-23T04:21:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.71919.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36635.log 2023-08-23T04:21:44.719 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71919.log.gz 2023-08-23T04:21:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48662.log 2023-08-23T04:21:44.719 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64859.log.gz 2023-08-23T04:21:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67707.log 2023-08-23T04:21:44.720 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36635.log.gz 2023-08-23T04:21:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74231.log 2023-08-23T04:21:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48662.log.gz 2023-08-23T04:21:44.720 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46891.log 2023-08-23T04:21:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67707.log.gz 2023-08-23T04:21:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43593.log 2023-08-23T04:21:44.721 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74231.log.gz 2023-08-23T04:21:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49613.log 2023-08-23T04:21:44.721 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46891.log.gz 2023-08-23T04:21:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57733.log 2023-08-23T04:21:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43593.log.gz 2023-08-23T04:21:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44588.log 2023-08-23T04:21:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71626.log 2023-08-23T04:21:44.722 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49613.log.gz 2023-08-23T04:21:44.723 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57733.log.gz 2023-08-23T04:21:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74871.log 2023-08-23T04:21:44.723 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44588.log.gz 2023-08-23T04:21:44.723 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.71626.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55575.log 2023-08-23T04:21:44.723 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71626.log.gz 2023-08-23T04:21:44.724 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36656.log 2023-08-23T04:21:44.724 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74871.log.gz 2023-08-23T04:21:44.724 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45659.log 2023-08-23T04:21:44.724 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55575.log.gz 2023-08-23T04:21:44.724 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66761.log 2023-08-23T04:21:44.725 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36656.log.gz 2023-08-23T04:21:44.725 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33615.log 2023-08-23T04:21:44.725 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45659.log.gz 2023-08-23T04:21:44.725 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75037.log 2023-08-23T04:21:44.725 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66761.log.gz 2023-08-23T04:21:44.726 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54245.log 2023-08-23T04:21:44.726 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33615.log.gz 2023-08-23T04:21:44.726 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74360.log 2023-08-23T04:21:44.726 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75037.log.gz 2023-08-23T04:21:44.727 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76961.log 2023-08-23T04:21:44.727 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54245.log.gz 2023-08-23T04:21:44.727 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32452.log 2023-08-23T04:21:44.727 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74360.log.gz 2023-08-23T04:21:44.727 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33897.log 2023-08-23T04:21:44.728 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76961.log.gz 2023-08-23T04:21:44.728 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47393.log 2023-08-23T04:21:44.728 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32452.log.gz 2023-08-23T04:21:44.728 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40325.log 2023-08-23T04:21:44.729 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33897.log.gz 2023-08-23T04:21:44.729 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45470.log 2023-08-23T04:21:44.729 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47393.log.gz 2023-08-23T04:21:44.729 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55897.log 2023-08-23T04:21:44.729 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40325.log.gz 2023-08-23T04:21:44.730 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79476.log 2023-08-23T04:21:44.730 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45470.log.gz 2023-08-23T04:21:44.730 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53297.log 2023-08-23T04:21:44.730 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55897.log.gz 2023-08-23T04:21:44.730 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49550.log 2023-08-23T04:21:44.731 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79476.log.gz 2023-08-23T04:21:44.731 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57095.log 2023-08-23T04:21:44.731 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53297.log: /var/log/ceph/ceph-client.admin.49550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53297.log.gz 2023-08-23T04:21:44.731 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49550.log.gz 2023-08-23T04:21:44.732 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34649.log 2023-08-23T04:21:44.732 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73058.log 2023-08-23T04:21:44.732 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57095.log.gz 2023-08-23T04:21:44.732 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57561.log 2023-08-23T04:21:44.732 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34649.log.gz 2023-08-23T04:21:44.733 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50785.log 2023-08-23T04:21:44.733 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73058.log.gz 2023-08-23T04:21:44.733 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52646.log 2023-08-23T04:21:44.733 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57561.log.gz 2023-08-23T04:21:44.733 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73266.log 2023-08-23T04:21:44.734 INFO:teuthology.orchestra.run.smithi012.stderr: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.50785.log.gz 2023-08-23T04:21:44.734 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.52646.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39475.log 2023-08-23T04:21:44.734 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52646.log.gz 2023-08-23T04:21:44.734 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67943.log 2023-08-23T04:21:44.735 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73266.log.gz 2023-08-23T04:21:44.735 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78035.log 2023-08-23T04:21:44.735 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39475.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39475.log.gz 2023-08-23T04:21:44.735 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64389.log 2023-08-23T04:21:44.735 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67943.log.gz 2023-08-23T04:21:44.736 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35948.log 2023-08-23T04:21:44.736 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78035.log.gz 2023-08-23T04:21:44.736 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.64389.log: --verbose -- /var/log/ceph/ceph-client.admin.70662.log 2023-08-23T04:21:44.736 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64389.log.gz 2023-08-23T04:21:44.737 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52624.log /var/log/ceph/ceph-client.admin.35948.log: 2023-08-23T04:21:44.737 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35948.log.gz 2023-08-23T04:21:44.737 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38099.log 2023-08-23T04:21:44.737 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70662.log.gz 2023-08-23T04:21:44.738 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43542.log 2023-08-23T04:21:44.738 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52624.log.gz 2023-08-23T04:21:44.738 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75058.log 2023-08-23T04:21:44.738 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38099.log.gz 2023-08-23T04:21:44.738 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59541.log 2023-08-23T04:21:44.739 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43542.log.gz 2023-08-23T04:21:44.739 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43525.log 2023-08-23T04:21:44.739 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75058.log.gz 2023-08-23T04:21:44.739 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67621.log 2023-08-23T04:21:44.740 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59541.log.gz 2023-08-23T04:21:44.740 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59455.log 2023-08-23T04:21:44.740 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43525.log.gz 2023-08-23T04:21:44.740 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47968.log 2023-08-23T04:21:44.740 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67621.log.gz 2023-08-23T04:21:44.741 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39407.log 2023-08-23T04:21:44.741 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59455.log.gz 2023-08-23T04:21:44.741 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60227.log 2023-08-23T04:21:44.741 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47968.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47968.log.gz 2023-08-23T04:21:44.741 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36034.log 2023-08-23T04:21:44.742 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39407.log.gz 2023-08-23T04:21:44.742 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57669.log 2023-08-23T04:21:44.742 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60227.log.gz 2023-08-23T04:21:44.742 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60695.log 2023-08-23T04:21:44.742 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36034.log.gz 2023-08-23T04:21:44.743 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64881.log 2023-08-23T04:21:44.743 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57669.log.gz 2023-08-23T04:21:44.743 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44231.log 2023-08-23T04:21:44.743 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60695.log.gz 2023-08-23T04:21:44.743 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61724.log 2023-08-23T04:21:44.744 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64881.log.gz 2023-08-23T04:21:44.744 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42467.log 2023-08-23T04:21:44.744 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44231.log.gz 2023-08-23T04:21:44.744 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78332.log 2023-08-23T04:21:44.744 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61724.log.gz 2023-08-23T04:21:44.745 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50309.log 2023-08-23T04:21:44.745 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42467.log.gz 2023-08-23T04:21:44.745 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49283.log 2023-08-23T04:21:44.745 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78332.log.gz 2023-08-23T04:21:44.745 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71152.log 2023-08-23T04:21:44.746 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50107.log 2023-08-23T04:21:44.746 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50309.log.gz 2023-08-23T04:21:44.746 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49283.log: /var/log/ceph/ceph-client.admin.71152.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.49283.log.gz 2023-08-23T04:21:44.746 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.55469.log 2023-08-23T04:21:44.746 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71152.log.gz 2023-08-23T04:21:44.747 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61767.log 2023-08-23T04:21:44.747 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50107.log.gz 2023-08-23T04:21:44.747 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62714.log 2023-08-23T04:21:44.747 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55469.log.gz 2023-08-23T04:21:44.748 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44756.log 2023-08-23T04:21:44.748 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61767.log.gz 2023-08-23T04:21:44.748 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58697.log 2023-08-23T04:21:44.748 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62714.log.gz 2023-08-23T04:21:44.748 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.44756.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60310.log 2023-08-23T04:21:44.749 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44756.log.gz 2023-08-23T04:21:44.749 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75633.log 2023-08-23T04:21:44.749 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58697.log.gz 2023-08-23T04:21:44.749 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71667.log 2023-08-23T04:21:44.749 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60310.log.gz 2023-08-23T04:21:44.750 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.75633.log: --verbose -- /var/log/ceph/ceph-client.admin.76106.log 2023-08-23T04:21:44.750 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75633.log.gz 2023-08-23T04:21:44.750 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57970.log 2023-08-23T04:21:44.750 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71667.log.gz 2023-08-23T04:21:44.750 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68674.log 2023-08-23T04:21:44.751 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76106.log.gz 2023-08-23T04:21:44.751 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.57970.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.41587.log 2023-08-23T04:21:44.751 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57970.log.gz 2023-08-23T04:21:44.751 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69816.log 2023-08-23T04:21:44.751 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68674.log.gz 2023-08-23T04:21:44.752 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69660.log 2023-08-23T04:21:44.752 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41587.log.gz 2023-08-23T04:21:44.752 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35787.log 2023-08-23T04:21:44.752 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69816.log.gz 2023-08-23T04:21:44.752 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46184.log 2023-08-23T04:21:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69660.log.gz 2023-08-23T04:21:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38206.log 2023-08-23T04:21:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35787.log.gz 2023-08-23T04:21:44.753 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79422.log 2023-08-23T04:21:44.754 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46184.log.gz 2023-08-23T04:21:44.754 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53493.log 2023-08-23T04:21:44.754 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38206.log.gz 2023-08-23T04:21:44.754 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69952.log 2023-08-23T04:21:44.754 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79422.log.gz 2023-08-23T04:21:44.755 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40787.log 2023-08-23T04:21:44.755 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48641.log 2023-08-23T04:21:44.755 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53493.log.gz 2023-08-23T04:21:44.755 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69952.log.gz 2023-08-23T04:21:44.756 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42367.log 2023-08-23T04:21:44.756 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40787.log.gz 2023-08-23T04:21:44.756 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.48641.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.74167.log 2023-08-23T04:21:44.756 INFO:teuthology.orchestra.run.smithi012.stderr: 42.9% -- replaced with /var/log/ceph/ceph-client.admin.48641.log.gz 2023-08-23T04:21:44.756 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64730.log 2023-08-23T04:21:44.757 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42367.log.gz 2023-08-23T04:21:44.757 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.74167.log: --verbose -- /var/log/ceph/ceph-client.admin.65344.log 2023-08-23T04:21:44.757 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74167.log.gz 2023-08-23T04:21:44.757 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49040.log 2023-08-23T04:21:44.757 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64730.log.gz 2023-08-23T04:21:44.758 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76490.log 2023-08-23T04:21:44.758 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65344.log.gz 2023-08-23T04:21:44.758 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.49040.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37564.log 2023-08-23T04:21:44.758 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49040.log.gz 2023-08-23T04:21:44.759 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71054.log 2023-08-23T04:21:44.759 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38999.log 2023-08-23T04:21:44.759 INFO:teuthology.orchestra.run.smithi012.stderr: 56.3% -- replaced with /var/log/ceph/ceph-client.admin.76490.log.gz 2023-08-23T04:21:44.759 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37564.log.gz 2023-08-23T04:21:44.759 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64601.log 2023-08-23T04:21:44.760 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71054.log: 53.5% -- replaced with /var/log/ceph/ceph-client.admin.71054.log.gz 2023-08-23T04:21:44.760 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37086.log 2023-08-23T04:21:44.760 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38999.log.gz 2023-08-23T04:21:44.760 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.64601.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47947.log 2023-08-23T04:21:44.760 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64601.log.gz 2023-08-23T04:21:44.761 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71305.log 2023-08-23T04:21:44.761 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37086.log.gz 2023-08-23T04:21:44.761 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75444.log 2023-08-23T04:21:44.761 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47947.log.gz 2023-08-23T04:21:44.761 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.71305.log: -- /var/log/ceph/ceph-client.admin.59842.log 2023-08-23T04:21:44.762 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71305.log.gz 2023-08-23T04:21:44.762 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.75444.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57263.log 2023-08-23T04:21:44.762 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75444.log.gz 2023-08-23T04:21:44.762 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75139.log 2023-08-23T04:21:44.762 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59842.log.gz 2023-08-23T04:21:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75913.log 2023-08-23T04:21:44.763 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57263.log.gz 2023-08-23T04:21:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45428.log 2023-08-23T04:21:44.763 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75139.log.gz 2023-08-23T04:21:44.763 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61574.log 2023-08-23T04:21:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75913.log.gz 2023-08-23T04:21:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42896.log 2023-08-23T04:21:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45428.log: 23.3% -- replaced with /var/log/ceph/ceph-client.admin.45428.log.gz 2023-08-23T04:21:44.764 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63025.log 2023-08-23T04:21:44.764 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61574.log.gz 2023-08-23T04:21:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38846.log 2023-08-23T04:21:44.765 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42896.log.gz 2023-08-23T04:21:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49343.log 2023-08-23T04:21:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63025.log.gz 2023-08-23T04:21:44.765 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62134.log 2023-08-23T04:21:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38846.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38846.log.gz 2023-08-23T04:21:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40947.log 2023-08-23T04:21:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49343.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49343.log.gz 2023-08-23T04:21:44.766 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73393.log 2023-08-23T04:21:44.767 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62134.log.gz 2023-08-23T04:21:44.767 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77305.log 2023-08-23T04:21:44.767 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40947.log.gz 2023-08-23T04:21:44.767 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44315.log 2023-08-23T04:21:44.768 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73393.log.gz 2023-08-23T04:21:44.768 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66825.log 2023-08-23T04:21:44.768 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77305.log.gz 2023-08-23T04:21:44.768 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55961.log 2023-08-23T04:21:44.768 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44315.log: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.44315.log.gz 2023-08-23T04:21:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47373.log 2023-08-23T04:21:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66825.log.gz 2023-08-23T04:21:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71131.log 2023-08-23T04:21:44.769 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55961.log.gz 2023-08-23T04:21:44.770 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45806.log 2023-08-23T04:21:44.770 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47373.log.gz 2023-08-23T04:21:44.770 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43967.log 2023-08-23T04:21:44.770 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71131.log.gz 2023-08-23T04:21:44.770 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57690.log 2023-08-23T04:21:44.771 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45806.log: 22.5% -- replaced with /var/log/ceph/ceph-client.admin.45806.log.gz 2023-08-23T04:21:44.771 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61853.log 2023-08-23T04:21:44.771 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43967.log.gz 2023-08-23T04:21:44.771 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52710.log 2023-08-23T04:21:44.771 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57690.log.gz 2023-08-23T04:21:44.772 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48414.log 2023-08-23T04:21:44.772 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61853.log.gz 2023-08-23T04:21:44.772 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36828.log 2023-08-23T04:21:44.772 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52710.log.gz 2023-08-23T04:21:44.773 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39917.log 2023-08-23T04:21:44.773 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48414.log.gz 2023-08-23T04:21:44.773 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45071.log 2023-08-23T04:21:44.773 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36828.log.gz 2023-08-23T04:21:44.774 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56972.log 2023-08-23T04:21:44.774 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39917.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39917.log.gz 2023-08-23T04:21:44.774 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-08-23T04:21:44.774 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45071.log.gz 2023-08-23T04:21:44.775 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61445.log 2023-08-23T04:21:44.775 INFO:teuthology.orchestra.run.smithi012.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.56972.log.gz 2023-08-23T04:21:44.775 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32614.log 2023-08-23T04:21:44.775 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71248.log 2023-08-23T04:21:44.775 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61445.log.gz 2023-08-23T04:21:44.776 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38335.log 2023-08-23T04:21:44.776 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32614.log.gz 2023-08-23T04:21:44.776 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42067.log 2023-08-23T04:21:44.776 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71248.log.gz 2023-08-23T04:21:44.776 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51481.log 2023-08-23T04:21:44.777 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38335.log.gz 2023-08-23T04:21:44.777 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47239.log 2023-08-23T04:21:44.777 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42067.log.gz 2023-08-23T04:21:44.777 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77090.log 2023-08-23T04:21:44.778 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51481.log.gz 2023-08-23T04:21:44.778 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47020.log 2023-08-23T04:21:44.778 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47239.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.47239.log.gz 2023-08-23T04:21:44.778 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.77090.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39288.log 2023-08-23T04:21:44.778 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77090.log.gz 2023-08-23T04:21:44.779 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.47020.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45638.log 2023-08-23T04:21:44.779 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47020.log.gz 2023-08-23T04:21:44.779 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.39288.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44441.log 2023-08-23T04:21:44.779 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39288.log.gz 2023-08-23T04:21:44.779 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60760.log 2023-08-23T04:21:44.780 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45638.log: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.45638.log.gz 2023-08-23T04:21:44.780 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76063.log 2023-08-23T04:21:44.780 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44441.log.gz 2023-08-23T04:21:44.780 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73350.log 2023-08-23T04:21:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60760.log.gz 2023-08-23T04:21:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41987.log 2023-08-23T04:21:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76063.log.gz 2023-08-23T04:21:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62026.log 2023-08-23T04:21:44.781 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73350.log.gz 2023-08-23T04:21:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40410.log 2023-08-23T04:21:44.782 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41987.log.gz 2023-08-23T04:21:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76020.log 2023-08-23T04:21:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62026.log.gz 2023-08-23T04:21:44.782 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35606.log 2023-08-23T04:21:44.783 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40410.log.gz 2023-08-23T04:21:44.783 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42998.log 2023-08-23T04:21:44.783 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76020.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76020.log.gz 2023-08-23T04:21:44.783 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53858.log 2023-08-23T04:21:44.783 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64924.log 2023-08-23T04:21:44.784 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35606.log.gz 2023-08-23T04:21:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42998.log.gz 2023-08-23T04:21:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34157.log 2023-08-23T04:21:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53858.log.gz 2023-08-23T04:21:44.784 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43627.log 2023-08-23T04:21:44.785 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64924.log.gz 2023-08-23T04:21:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.34157.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.61488.log 2023-08-23T04:21:44.785 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34157.log.gz 2023-08-23T04:21:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56521.log 2023-08-23T04:21:44.785 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43627.log.gz 2023-08-23T04:21:44.786 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75464.log 2023-08-23T04:21:44.786 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61488.log.gz 2023-08-23T04:21:44.786 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70819.log 2023-08-23T04:21:44.786 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56521.log.gz 2023-08-23T04:21:44.786 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65480.log 2023-08-23T04:21:44.787 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75464.log: 11.1% -- replaced with /var/log/ceph/ceph-client.admin.75464.log.gz 2023-08-23T04:21:44.787 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49799.log 2023-08-23T04:21:44.787 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70819.log.gz 2023-08-23T04:21:44.787 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74468.log 2023-08-23T04:21:44.788 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65480.log.gz 2023-08-23T04:21:44.788 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76596.log 2023-08-23T04:21:44.788 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49799.log.gz 2023-08-23T04:21:44.788 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63708.log 2023-08-23T04:21:44.788 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74468.log.gz 2023-08-23T04:21:44.789 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65203.log 2023-08-23T04:21:44.789 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76596.log.gz 2023-08-23T04:21:44.789 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32854.log 2023-08-23T04:21:44.789 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63708.log.gz 2023-08-23T04:21:44.789 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69624.log 2023-08-23T04:21:44.790 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65203.log.gz 2023-08-23T04:21:44.790 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42539.log 2023-08-23T04:21:44.790 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32854.log.gz 2023-08-23T04:21:44.790 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49693.log 2023-08-23T04:21:44.790 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69624.log.gz 2023-08-23T04:21:44.791 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39254.log 2023-08-23T04:21:44.791 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42539.log.gz 2023-08-23T04:21:44.791 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43253.log 2023-08-23T04:21:44.791 INFO:teuthology.orchestra.run.smithi012.stderr: 56.5% -- replaced with /var/log/ceph/ceph-client.admin.49693.log.gz 2023-08-23T04:21:44.791 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35991.log 2023-08-23T04:21:44.792 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39254.log.gz 2023-08-23T04:21:44.792 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56543.log 2023-08-23T04:21:44.792 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43253.log.gz 2023-08-23T04:21:44.792 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35991.log.gz 2023-08-23T04:21:44.792 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51976.log 2023-08-23T04:21:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44714.log 2023-08-23T04:21:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56543.log.gz 2023-08-23T04:21:44.793 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77954.log 2023-08-23T04:21:44.793 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51976.log.gz 2023-08-23T04:21:44.794 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53643.log 2023-08-23T04:21:44.794 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44714.log.gz 2023-08-23T04:21:44.794 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.77954.log: --verbose -- /var/log/ceph/ceph-client.admin.36721.log 2023-08-23T04:21:44.794 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77954.log.gz 2023-08-23T04:21:44.794 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66481.log 2023-08-23T04:21:44.795 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53643.log.gz 2023-08-23T04:21:44.795 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34110.log 2023-08-23T04:21:44.795 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36721.log.gz 2023-08-23T04:21:44.795 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43848.log 2023-08-23T04:21:44.796 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66481.log.gz 2023-08-23T04:21:44.796 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71014.log 2023-08-23T04:21:44.796 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34110.log.gz 2023-08-23T04:21:44.796 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76575.log 2023-08-23T04:21:44.796 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43848.log.gz 2023-08-23T04:21:44.797 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75119.log 2023-08-23T04:21:44.797 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71014.log.gz 2023-08-23T04:21:44.797 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.76575.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53472.log 2023-08-23T04:21:44.797 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76575.log.gz 2023-08-23T04:21:44.797 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79584.log 2023-08-23T04:21:44.798 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75119.log.gz 2023-08-23T04:21:44.798 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69543.log 2023-08-23T04:21:44.798 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53472.log.gz 2023-08-23T04:21:44.798 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49653.log 2023-08-23T04:21:44.798 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79584.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79584.log.gz 2023-08-23T04:21:44.799 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53120.log 2023-08-23T04:21:44.799 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69543.log.gz 2023-08-23T04:21:44.799 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62964.log 2023-08-23T04:21:44.799 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49653.log.gz 2023-08-23T04:21:44.799 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32398.log 2023-08-23T04:21:44.800 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53120.log.gz 2023-08-23T04:21:44.800 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43559.log 2023-08-23T04:21:44.800 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62964.log.gz 2023-08-23T04:21:44.800 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55364.log 2023-08-23T04:21:44.800 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32398.log.gz 2023-08-23T04:21:44.801 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61660.log 2023-08-23T04:21:44.801 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43559.log.gz 2023-08-23T04:21:44.801 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34365.log 2023-08-23T04:21:44.801 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55364.log: 26.4% -- replaced with /var/log/ceph/ceph-client.admin.55364.log.gz 2023-08-23T04:21:44.801 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63428.log 2023-08-23T04:21:44.802 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61660.log.gz 2023-08-23T04:21:44.802 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72456.log 2023-08-23T04:21:44.802 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34365.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34365.log.gz 2023-08-23T04:21:44.802 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68749.log 2023-08-23T04:21:44.802 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63428.log.gz 2023-08-23T04:21:44.803 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log /var/log/ceph/ceph-client.admin.72456.log: 2023-08-23T04:21:44.803 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72456.log.gz 2023-08-23T04:21:44.803 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70272.log 2023-08-23T04:21:44.803 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68749.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68749.log.gz 2023-08-23T04:21:44.803 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60470.log 2023-08-23T04:21:44.804 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.70272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73079.log 2023-08-23T04:21:44.804 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70272.log.gz 2023-08-23T04:21:44.804 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.60470.log: --verbose -- /var/log/ceph/ceph-client.admin.50846.log 2023-08-23T04:21:44.804 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60470.log.gz 2023-08-23T04:21:44.805 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43491.log 2023-08-23T04:21:44.805 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73079.log: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-23T04:21:44.805 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73079.log.gz 2023-08-23T04:21:44.805 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78495.log 2023-08-23T04:21:44.805 INFO:teuthology.orchestra.run.smithi012.stderr: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.50846.log.gz 2023-08-23T04:21:44.806 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43100.log 2023-08-23T04:21:44.806 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43491.log.gz 2023-08-23T04:21:44.806 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36098.log 2023-08-23T04:21:44.806 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78495.log.gz 2023-08-23T04:21:44.806 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64709.log 2023-08-23T04:21:44.807 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43100.log.gz 2023-08-23T04:21:44.807 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69912.log 2023-08-23T04:21:44.807 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36098.log.gz 2023-08-23T04:21:44.807 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46332.log 2023-08-23T04:21:44.808 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64709.log.gz 2023-08-23T04:21:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43066.log 2023-08-23T04:21:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69912.log.gz 2023-08-23T04:21:44.808 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72155.log 2023-08-23T04:21:44.808 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46332.log.gz 2023-08-23T04:21:44.809 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55532.log /var/log/ceph/ceph-client.admin.43066.log: 2023-08-23T04:21:44.809 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43066.log.gz 2023-08-23T04:21:44.809 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.72155.log: --verbose -- /var/log/ceph/ceph-client.admin.67814.log 2023-08-23T04:21:44.809 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72155.log.gz 2023-08-23T04:21:44.809 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37682.log 2023-08-23T04:21:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55532.log.gz 2023-08-23T04:21:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38722.log 2023-08-23T04:21:44.810 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67814.log.gz 2023-08-23T04:21:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70679.log 2023-08-23T04:21:44.810 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37682.log.gz 2023-08-23T04:21:44.811 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50926.log 2023-08-23T04:21:44.811 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38722.log.gz 2023-08-23T04:21:44.811 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50069.log 2023-08-23T04:21:44.811 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70679.log.gz 2023-08-23T04:21:44.812 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34833.log 2023-08-23T04:21:44.812 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50926.log: 31.5% -- replaced with /var/log/ceph/ceph-client.admin.50926.log.gz 2023-08-23T04:21:44.812 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68617.log 2023-08-23T04:21:44.812 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50069.log: 23.7% -- replaced with /var/log/ceph/ceph-client.admin.50069.log.gz 2023-08-23T04:21:44.812 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72628.log 2023-08-23T04:21:44.813 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34833.log.gz 2023-08-23T04:21:44.813 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51288.log 2023-08-23T04:21:44.813 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68617.log.gz 2023-08-23T04:21:44.813 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79395.log 2023-08-23T04:21:44.813 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72628.log.gz 2023-08-23T04:21:44.814 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.51288.log: --verbose -- /var/log/ceph/ceph-client.admin.35004.log 2023-08-23T04:21:44.814 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51288.log.gz 2023-08-23T04:21:44.814 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41207.log 2023-08-23T04:21:44.814 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79395.log.gz 2023-08-23T04:21:44.814 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67685.log 2023-08-23T04:21:44.815 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35004.log.gz 2023-08-23T04:21:44.815 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.41207.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39764.log 2023-08-23T04:21:44.815 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41207.log.gz 2023-08-23T04:21:44.815 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70719.log 2023-08-23T04:21:44.816 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67685.log.gz 2023-08-23T04:21:44.816 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49944.log 2023-08-23T04:21:44.816 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42047.log 2023-08-23T04:21:44.816 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39764.log.gz 2023-08-23T04:21:44.817 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70719.log: /var/log/ceph/ceph-client.admin.49944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66589.log 2023-08-23T04:21:44.817 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70719.log.gz 2023-08-23T04:21:44.817 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49944.log.gz 2023-08-23T04:21:44.817 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40847.log 2023-08-23T04:21:44.817 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42047.log.gz 2023-08-23T04:21:44.818 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65010.log 2023-08-23T04:21:44.818 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66589.log.gz 2023-08-23T04:21:44.818 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35069.log 2023-08-23T04:21:44.818 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40847.log.gz 2023-08-23T04:21:44.819 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50387.log 2023-08-23T04:21:44.819 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65010.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65010.log.gz-5 2023-08-23T04:21:44.819 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.44777.log 2023-08-23T04:21:44.819 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35069.log.gz 2023-08-23T04:21:44.820 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51890.log 2023-08-23T04:21:44.820 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50387.log: 0.0%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.50387.log.gz-- 2023-08-23T04:21:44.820 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76897.log 2023-08-23T04:21:44.820 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44777.log.gz 2023-08-23T04:21:44.821 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35456.log 2023-08-23T04:21:44.821 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51890.log.gz 2023-08-23T04:21:44.821 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39951.log 2023-08-23T04:21:44.821 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76897.log.gz 2023-08-23T04:21:44.821 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59670.log 2023-08-23T04:21:44.822 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35456.log.gz 2023-08-23T04:21:44.822 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34137.log 2023-08-23T04:21:44.822 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39951.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39951.log.gz 2023-08-23T04:21:44.822 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42247.log 2023-08-23T04:21:44.822 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59670.log.gz 2023-08-23T04:21:44.823 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.34137.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.48162.log 2023-08-23T04:21:44.823 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34137.log.gz 2023-08-23T04:21:44.823 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48683.log 2023-08-23T04:21:44.823 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42247.log.gz 2023-08-23T04:21:44.824 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61552.log 2023-08-23T04:21:44.824 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48162.log.gz 2023-08-23T04:21:44.824 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68288.log 2023-08-23T04:21:44.824 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48683.log.gz 2023-08-23T04:21:44.824 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.61552.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43321.log 2023-08-23T04:21:44.825 INFO:teuthology.orchestra.run.smithi012.stderr: 24.5% -- replaced with /var/log/ceph/ceph-client.admin.61552.log.gz 2023-08-23T04:21:44.825 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38464.log 2023-08-23T04:21:44.825 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68288.log.gz 2023-08-23T04:21:44.825 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45953.log 2023-08-23T04:21:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43321.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43321.log.gz 2023-08-23T04:21:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52603.log 2023-08-23T04:21:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38464.log.gz 2023-08-23T04:21:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57884.log 2023-08-23T04:21:44.826 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45953.log: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.45953.log.gz 2023-08-23T04:21:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56887.log 2023-08-23T04:21:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52603.log.gz 2023-08-23T04:21:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48620.log 2023-08-23T04:21:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57884.log.gz 2023-08-23T04:21:44.827 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42347.log 2023-08-23T04:21:44.828 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56887.log.gz 2023-08-23T04:21:44.828 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45512.log 2023-08-23T04:21:44.828 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48620.log: 57.1% -- replaced with /var/log/ceph/ceph-client.admin.48620.log.gz 2023-08-23T04:21:44.828 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32802.log 2023-08-23T04:21:44.829 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42347.log.gz 2023-08-23T04:21:44.829 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38185.log 2023-08-23T04:21:44.829 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45512.log.gz 2023-08-23T04:21:44.829 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54457.log 2023-08-23T04:21:44.829 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32802.log.gz 2023-08-23T04:21:44.830 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72048.log 2023-08-23T04:21:44.830 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38185.log.gz 2023-08-23T04:21:44.830 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75891.log 2023-08-23T04:21:44.830 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54457.log.gz 2023-08-23T04:21:44.830 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33872.log 2023-08-23T04:21:44.831 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72048.log.gz 2023-08-23T04:21:44.831 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35904.log 2023-08-23T04:21:44.831 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75891.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75891.log.gz 2023-08-23T04:21:44.831 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33872.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.33872.log.gz 2023-08-23T04:21:44.831 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38443.log 2023-08-23T04:21:44.832 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68366.log 2023-08-23T04:21:44.832 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35904.log.gz 2023-08-23T04:21:44.832 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50768.log 2023-08-23T04:21:44.832 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38443.log.gz 2023-08-23T04:21:44.832 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63966.log 2023-08-23T04:21:44.833 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68366.log.gz 2023-08-23T04:21:44.833 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.50768.log: --verbose -- /var/log/ceph/ceph-client.admin.52560.log 2023-08-23T04:21:44.833 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50768.log.gz 2023-08-23T04:21:44.833 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51088.log 2023-08-23T04:21:44.833 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63966.log.gz 2023-08-23T04:21:44.834 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70069.log 2023-08-23T04:21:44.834 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52560.log.gz 2023-08-23T04:21:44.834 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56285.log 2023-08-23T04:21:44.834 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51088.log: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.51088.log.gz 2023-08-23T04:21:44.834 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.70069.log: -- /var/log/ceph/ceph-client.admin.77765.log 2023-08-23T04:21:44.835 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70069.log.gz 2023-08-23T04:21:44.835 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71962.log 2023-08-23T04:21:44.835 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56285.log.gz 2023-08-23T04:21:44.835 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70859.log 2023-08-23T04:21:44.835 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77765.log.gz 2023-08-23T04:21:44.836 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69501.log 2023-08-23T04:21:44.836 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71962.log.gz 2023-08-23T04:21:44.836 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41327.log 2023-08-23T04:21:44.836 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70859.log.gz 2023-08-23T04:21:44.837 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56478.log 2023-08-23T04:21:44.837 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69501.log.gz 2023-08-23T04:21:45.120 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55203.log 2023-08-23T04:21:45.120 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41327.log.gz 2023-08-23T04:21:45.121 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63794.log 2023-08-23T04:21:45.121 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56478.log.gz 2023-08-23T04:21:45.121 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55203.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.55203.log.gz 2023-08-23T04:21:45.121 INFO:teuthology.orchestra.run.smithi012.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.76682.log 2023-08-23T04:21:45.121 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59950.log 2023-08-23T04:21:45.122 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63794.log.gz 2023-08-23T04:21:45.122 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52775.log 2023-08-23T04:21:45.122 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76682.log.gz 2023-08-23T04:21:45.122 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46418.log 2023-08-23T04:21:45.123 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59950.log.gz 2023-08-23T04:21:45.123 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.52775.log: --verbose -- /var/log/ceph/ceph-client.admin.73629.log 2023-08-23T04:21:45.123 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52775.log.gz 2023-08-23T04:21:45.123 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75014.log 2023-08-23T04:21:45.123 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46418.log.gz 2023-08-23T04:21:45.124 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74038.log 2023-08-23T04:21:45.124 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73629.log.gz 2023-08-23T04:21:45.124 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39152.log 2023-08-23T04:21:45.124 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75014.log.gz 2023-08-23T04:21:45.124 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59692.log 2023-08-23T04:21:45.125 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74038.log.gz 2023-08-23T04:21:45.125 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68034.log 2023-08-23T04:21:45.125 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39152.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39152.log.gz 2023-08-23T04:21:45.125 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71878.log 2023-08-23T04:21:45.125 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59692.log.gz 2023-08-23T04:21:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77815.log 2023-08-23T04:21:45.126 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68034.log.gz 2023-08-23T04:21:45.126 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39424.log 2023-08-23T04:21:45.126 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71878.log.gz 2023-08-23T04:21:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71228.log 2023-08-23T04:21:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77815.log.gz 2023-08-23T04:21:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47084.log 2023-08-23T04:21:45.127 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39424.log.gz 2023-08-23T04:21:45.127 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44924.log 2023-08-23T04:21:45.128 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71228.log.gz 2023-08-23T04:21:45.128 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42845.log 2023-08-23T04:21:45.128 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47084.log.gz 2023-08-23T04:21:45.128 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76085.log 2023-08-23T04:21:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44924.log.gz 2023-08-23T04:21:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72112.log 2023-08-23T04:21:45.129 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42845.log.gz 2023-08-23T04:21:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51546.log 2023-08-23T04:21:45.129 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76085.log.gz 2023-08-23T04:21:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53084.log 2023-08-23T04:21:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72112.log.gz 2023-08-23T04:21:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77348.log 2023-08-23T04:21:45.130 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51546.log.gz 2023-08-23T04:21:45.130 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44069.log 2023-08-23T04:21:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53084.log.gz 2023-08-23T04:21:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77348.log.gz 2023-08-23T04:21:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53241.log 2023-08-23T04:21:45.131 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53923.log 2023-08-23T04:21:45.132 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44069.log.gz 2023-08-23T04:21:45.132 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56371.log 2023-08-23T04:21:45.132 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53241.log.gz 2023-08-23T04:21:45.132 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61961.log 2023-08-23T04:21:45.132 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53923.log.gz 2023-08-23T04:21:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.56371.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.61789.log 2023-08-23T04:21:45.133 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56371.log.gz 2023-08-23T04:21:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56586.log 2023-08-23T04:21:45.133 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61961.log.gz 2023-08-23T04:21:45.133 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57841.log 2023-08-23T04:21:45.134 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61789.log.gz 2023-08-23T04:21:45.134 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69019.log 2023-08-23T04:21:45.134 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56586.log.gz 2023-08-23T04:21:45.134 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55854.log 2023-08-23T04:21:45.134 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57841.log.gz 2023-08-23T04:21:45.135 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56047.log 2023-08-23T04:21:45.135 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69019.log.gz 2023-08-23T04:21:45.135 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70109.log 2023-08-23T04:21:45.135 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55854.log.gz 2023-08-23T04:21:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49143.log /var/log/ceph/ceph-client.admin.56047.log: 2023-08-23T04:21:45.136 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56047.log.gz 2023-08-23T04:21:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64838.log 2023-08-23T04:21:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70109.log.gz 2023-08-23T04:21:45.136 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44273.log 2023-08-23T04:21:45.137 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49143.log.gz 2023-08-23T04:21:45.137 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33808.log 2023-08-23T04:21:45.137 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64838.log.gz 2023-08-23T04:21:45.137 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60330.log 2023-08-23T04:21:45.137 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44273.log.gz 2023-08-23T04:21:45.138 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67212.log 2023-08-23T04:21:45.138 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33808.log.gz 2023-08-23T04:21:45.138 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59756.log 2023-08-23T04:21:45.138 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60330.log: 25.2% -- replaced with /var/log/ceph/ceph-client.admin.60330.log.gz 2023-08-23T04:21:45.138 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72789.log 2023-08-23T04:21:45.139 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67212.log.gz 2023-08-23T04:21:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33378.log 2023-08-23T04:21:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59756.log.gz 2023-08-23T04:21:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39900.log 2023-08-23T04:21:45.139 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72789.log: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.72789.log.gz 2023-08-23T04:21:45.140 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46504.log 2023-08-23T04:21:45.140 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33378.log.gz 2023-08-23T04:21:45.140 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33722.log 2023-08-23T04:21:45.140 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39900.log.gz 2023-08-23T04:21:45.141 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39628.log 2023-08-23T04:21:45.141 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46504.log.gz 2023-08-23T04:21:45.141 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48803.log 2023-08-23T04:21:45.141 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33722.log.gz 2023-08-23T04:21:45.141 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40607.log 2023-08-23T04:21:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39628.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39628.log.gz 2023-08-23T04:21:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46611.log 2023-08-23T04:21:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48803.log.gz 2023-08-23T04:21:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59713.log 2023-08-23T04:21:45.142 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40607.log.gz 2023-08-23T04:21:45.143 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75719.log 2023-08-23T04:21:45.143 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46611.log.gz 2023-08-23T04:21:45.143 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66438.log 2023-08-23T04:21:45.143 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59713.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.59713.log.gz/var/log/ceph/ceph-client.admin.54974.log 2023-08-23T04:21:45.143 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:21:45.144 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75719.log.gz 2023-08-23T04:21:45.144 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36163.log 2023-08-23T04:21:45.144 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66438.log.gz 2023-08-23T04:21:45.144 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.54974.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.45260.log 2023-08-23T04:21:45.144 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54974.log.gz 2023-08-23T04:21:45.145 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35842.log 2023-08-23T04:21:45.145 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36163.log.gz 2023-08-23T04:21:45.145 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63579.log 2023-08-23T04:21:45.145 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45260.log.gz 2023-08-23T04:21:45.145 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56004.log 2023-08-23T04:21:45.146 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35842.log.gz 2023-08-23T04:21:45.146 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37000.log 2023-08-23T04:21:45.146 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63579.log.gz 2023-08-23T04:21:45.146 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69989.log 2023-08-23T04:21:45.146 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56004.log.gz 2023-08-23T04:21:45.146 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55597.log 2023-08-23T04:21:45.147 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37000.log.gz 2023-08-23T04:21:45.147 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65462.log 2023-08-23T04:21:45.147 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43695.log 2023-08-23T04:21:45.147 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69989.log.gz 2023-08-23T04:21:45.148 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51632.log 2023-08-23T04:21:45.148 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55597.log.gz 2023-08-23T04:21:45.148 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65462.log.gz 2023-08-23T04:21:45.148 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42828.log 2023-08-23T04:21:45.148 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43695.log.gz 2023-08-23T04:21:45.149 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56112.log 2023-08-23T04:21:45.149 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51632.log.gz 2023-08-23T04:21:45.149 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74790.log 2023-08-23T04:21:45.149 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67191.log 2023-08-23T04:21:45.149 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42828.log.gz 2023-08-23T04:21:45.150 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69642.log 2023-08-23T04:21:45.150 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56112.log.gz/var/log/ceph/ceph-client.admin.74790.log: 2023-08-23T04:21:45.150 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74790.log.gz 2023-08-23T04:21:45.150 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71268.log 2023-08-23T04:21:45.151 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67191.log.gz 2023-08-23T04:21:45.151 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38486.log 2023-08-23T04:21:45.151 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69642.log.gz 2023-08-23T04:21:45.151 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.71268.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.33185.log 2023-08-23T04:21:45.151 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71268.log.gz 2023-08-23T04:21:45.152 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46590.log 2023-08-23T04:21:45.152 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38486.log.gz 2023-08-23T04:21:45.152 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49219.log 2023-08-23T04:21:45.152 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33185.log.gz 2023-08-23T04:21:45.153 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49003.log 2023-08-23T04:21:45.153 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46590.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46590.log.gz 2023-08-23T04:21:45.153 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42107.log 2023-08-23T04:21:45.153 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49219.log.gz 2023-08-23T04:21:45.153 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68500.log 2023-08-23T04:21:45.154 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49003.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.49003.log.gz 2023-08-23T04:21:45.154 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38271.log 2023-08-23T04:21:45.154 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42107.log.gz 2023-08-23T04:21:45.154 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35219.log 2023-08-23T04:21:45.154 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68500.log.gz 2023-08-23T04:21:45.155 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41907.log 2023-08-23T04:21:45.155 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38271.log.gz 2023-08-23T04:21:45.155 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50627.log 2023-08-23T04:21:45.155 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35219.log.gz 2023-08-23T04:21:45.155 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33593.log 2023-08-23T04:21:45.156 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41907.log.gz 2023-08-23T04:21:45.156 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67771.log 2023-08-23T04:21:45.156 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50627.log.gz 2023-08-23T04:21:45.156 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60350.log 2023-08-23T04:21:45.156 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33593.log.gz 2023-08-23T04:21:45.157 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55789.log 2023-08-23T04:21:45.157 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67771.log.gz 2023-08-23T04:21:45.157 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62564.log 2023-08-23T04:21:45.157 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60350.log.gz 2023-08-23T04:21:45.157 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41927.log 2023-08-23T04:21:45.158 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55789.log.gz 2023-08-23T04:21:45.158 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59928.log 2023-08-23T04:21:45.158 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62564.log.gz 2023-08-23T04:21:45.158 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36249.log 2023-08-23T04:21:45.158 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41927.log.gz 2023-08-23T04:21:45.159 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49778.log 2023-08-23T04:21:45.159 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59928.log.gz 2023-08-23T04:21:45.159 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45911.log 2023-08-23T04:21:45.159 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36249.log.gz 2023-08-23T04:21:45.160 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.49778.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53901.log 2023-08-23T04:21:45.160 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49778.log.gz 2023-08-23T04:21:45.160 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70150.log 2023-08-23T04:21:45.160 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45911.log.gz 2023-08-23T04:21:45.160 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33464.log 2023-08-23T04:21:45.161 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53901.log: 0.0%/var/log/ceph/ceph-client.admin.70150.log: -- replaced with /var/log/ceph/ceph-client.admin.53901.log.gz 2023-08-23T04:21:45.161 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51309.log 2023-08-23T04:21:45.161 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70150.log.gz 2023-08-23T04:21:45.161 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67578.log 2023-08-23T04:21:45.161 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33464.log.gz 2023-08-23T04:21:45.162 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42607.log 2023-08-23T04:21:45.162 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51309.log: gzip 22.9%-5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.51309.log.gz/var/log/ceph/ceph-client.admin.33765.log 2023-08-23T04:21:45.162 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:21:45.162 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67578.log: /var/log/ceph/ceph-client.admin.42607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54800.log 2023-08-23T04:21:45.162 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67578.log.gz 2023-08-23T04:21:45.163 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42607.log.gz 2023-08-23T04:21:45.163 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.33765.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42981.log 2023-08-23T04:21:45.163 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33765.log.gz 2023-08-23T04:21:45.163 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41967.log 2023-08-23T04:21:45.163 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54800.log.gz 2023-08-23T04:21:45.164 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73099.log 2023-08-23T04:21:45.164 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42981.log.gz 2023-08-23T04:21:45.164 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63299.log 2023-08-23T04:21:45.164 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41967.log.gz 2023-08-23T04:21:45.164 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72478.log 2023-08-23T04:21:45.165 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73099.log.gz 2023-08-23T04:21:45.165 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41407.log 2023-08-23T04:21:45.165 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63299.log.gz 2023-08-23T04:21:45.165 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63858.log 2023-08-23T04:21:45.165 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72478.log.gz 2023-08-23T04:21:45.166 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55344.log 2023-08-23T04:21:45.166 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41407.log.gz 2023-08-23T04:21:45.166 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34813.log 2023-08-23T04:21:45.166 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63858.log.gz 2023-08-23T04:21:45.167 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66356.log 2023-08-23T04:21:45.167 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55344.log.gz 2023-08-23T04:21:45.167 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40827.log 2023-08-23T04:21:45.167 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34813.log.gz 2023-08-23T04:21:45.167 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48579.log 2023-08-23T04:21:45.168 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66356.log.gz 2023-08-23T04:21:45.168 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68870.log 2023-08-23T04:21:45.168 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40827.log.gz 2023-08-23T04:21:45.168 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.48579.log: --verbose -- /var/log/ceph/ceph-client.admin.53944.log 2023-08-23T04:21:45.168 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48579.log.gz 2023-08-23T04:21:45.169 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.68870.log: --verbose -- /var/log/ceph/ceph-client.admin.47538.log 2023-08-23T04:21:45.169 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68870.log.gz 2023-08-23T04:21:45.169 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79338.log 2023-08-23T04:21:45.169 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53944.log.gz 2023-08-23T04:21:45.169 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75384.log 2023-08-23T04:21:45.170 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47538.log.gz 2023-08-23T04:21:45.170 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54414.log /var/log/ceph/ceph-client.admin.79338.log: 2023-08-23T04:21:45.170 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79338.log.gz 2023-08-23T04:21:45.170 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69564.log 2023-08-23T04:21:45.170 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75384.log.gz 2023-08-23T04:21:45.171 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52040.log 2023-08-23T04:21:45.171 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54414.log.gz 2023-08-23T04:21:45.171 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.69564.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.75243.log 2023-08-23T04:21:45.171 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69564.log.gz 2023-08-23T04:21:45.171 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74554.log 2023-08-23T04:21:45.172 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52040.log.gz 2023-08-23T04:21:45.172 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65796.log 2023-08-23T04:21:45.172 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75243.log.gz 2023-08-23T04:21:45.172 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44035.log 2023-08-23T04:21:45.172 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74554.log.gz 2023-08-23T04:21:45.173 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39713.log 2023-08-23T04:21:45.173 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65796.log.gz 2023-08-23T04:21:45.173 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41707.log 2023-08-23T04:21:45.173 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44035.log.gz 2023-08-23T04:21:45.173 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34072.log 2023-08-23T04:21:45.174 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39713.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39713.log.gz 2023-08-23T04:21:45.174 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32344.log 2023-08-23T04:21:45.174 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41707.log.gz 2023-08-23T04:21:45.174 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40138.log 2023-08-23T04:21:45.174 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34072.log.gz 2023-08-23T04:21:45.175 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40223.log 2023-08-23T04:21:45.175 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32344.log.gz 2023-08-23T04:21:45.175 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55284.log 2023-08-23T04:21:45.175 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40138.log.gz 2023-08-23T04:21:45.175 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40807.log 2023-08-23T04:21:45.176 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40223.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40223.log.gz 2023-08-23T04:21:45.176 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34385.log 2023-08-23T04:21:45.176 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55284.log.gz 2023-08-23T04:21:45.176 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53013.log 2023-08-23T04:21:45.176 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40807.log.gz 2023-08-23T04:21:45.177 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.34385.log: -- /var/log/ceph/ceph-client.admin.73694.log 2023-08-23T04:21:45.177 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34385.log.gz 2023-08-23T04:21:45.177 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75263.log 2023-08-23T04:21:45.177 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53013.log.gz 2023-08-23T04:21:45.178 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.73694.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35661.log 2023-08-23T04:21:45.178 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73694.log.gz 2023-08-23T04:21:45.178 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57432.log 2023-08-23T04:21:45.178 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75263.log.gz 2023-08-23T04:21:45.178 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39781.log 2023-08-23T04:21:45.179 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35661.log.gz 2023-08-23T04:21:45.179 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47333.log 2023-08-23T04:21:45.179 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45722.log 2023-08-23T04:21:45.179 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57432.log.gz 2023-08-23T04:21:45.180 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39781.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39781.log.gz 2023-08-23T04:21:45.180 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42760.log 2023-08-23T04:21:45.180 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47333.log.gz 2023-08-23T04:21:45.180 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.45722.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39577.log 2023-08-23T04:21:45.181 INFO:teuthology.orchestra.run.smithi012.stderr: 22.9% -- replaced with /var/log/ceph/ceph-client.admin.45722.log.gz 2023-08-23T04:21:45.181 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40907.log 2023-08-23T04:21:45.181 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42760.log.gz 2023-08-23T04:21:45.181 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53154.log 2023-08-23T04:21:45.181 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39577.log.gz 2023-08-23T04:21:45.182 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51188.log 2023-08-23T04:21:45.182 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40907.log.gz 2023-08-23T04:21:45.182 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48538.log 2023-08-23T04:21:45.182 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53154.log.gz 2023-08-23T04:21:45.182 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46121.log 2023-08-23T04:21:45.183 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51188.log: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.51188.log.gz 2023-08-23T04:21:45.183 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68135.log 2023-08-23T04:21:45.183 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48538.log.gz 2023-08-23T04:21:45.183 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36206.log 2023-08-23T04:21:45.184 INFO:teuthology.orchestra.run.smithi012.stderr: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.46121.log.gz 2023-08-23T04:21:45.184 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46100.log 2023-08-23T04:21:45.184 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68135.log.gz 2023-08-23T04:21:45.184 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.36206.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36378.log 2023-08-23T04:21:45.184 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36206.log.gz 2023-08-23T04:21:45.185 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76746.log 2023-08-23T04:21:45.185 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46100.log.gz 2023-08-23T04:21:45.185 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.36378.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.64409.log 2023-08-23T04:21:45.185 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36378.log.gz 2023-08-23T04:21:45.185 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72997.log 2023-08-23T04:21:45.186 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76746.log.gz 2023-08-23T04:21:45.186 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33486.log 2023-08-23T04:21:45.186 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64409.log.gz 2023-08-23T04:21:45.186 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55448.log 2023-08-23T04:21:45.187 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72997.log.gz 2023-08-23T04:21:45.187 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51067.log 2023-08-23T04:21:45.187 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33486.log.gz 2023-08-23T04:21:45.187 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63493.log 2023-08-23T04:21:45.187 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55448.log.gz 2023-08-23T04:21:45.188 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49922.log 2023-08-23T04:21:45.188 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51067.log.gz 2023-08-23T04:21:45.188 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40967.log 2023-08-23T04:21:45.188 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63493.log.gz 2023-08-23T04:21:45.188 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40567.log 2023-08-23T04:21:45.189 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49922.log: 56.9% -- replaced with /var/log/ceph/ceph-client.admin.49922.log.gz 2023-08-23T04:21:45.189 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48476.log 2023-08-23T04:21:45.189 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40967.log.gz 2023-08-23T04:21:45.189 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70622.log 2023-08-23T04:21:45.189 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40567.log.gz 2023-08-23T04:21:45.190 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78847.log 2023-08-23T04:21:45.190 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48476.log.gz 2023-08-23T04:21:45.190 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29516.log 2023-08-23T04:21:45.190 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70622.log.gz 2023-08-23T04:21:45.190 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62069.log 2023-08-23T04:21:45.191 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78847.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78847.log.gz 2023-08-23T04:21:45.191 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43712.log /var/log/ceph/ceph-client.admin.29516.log: 2023-08-23T04:21:45.191 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29516.log.gz 2023-08-23T04:21:45.191 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38636.log 2023-08-23T04:21:45.191 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62069.log.gz 2023-08-23T04:21:45.192 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76364.log 2023-08-23T04:21:45.192 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43712.log.gz 2023-08-23T04:21:45.192 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.38636.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47435.log 2023-08-23T04:21:45.192 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38636.log.gz 2023-08-23T04:21:45.192 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65854.log 2023-08-23T04:21:45.193 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76364.log.gz 2023-08-23T04:21:45.193 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.47435.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.69932.log 2023-08-23T04:21:45.193 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47435.log.gz 2023-08-23T04:21:45.193 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54821.log 2023-08-23T04:21:45.193 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65854.log: 11.6% -- replaced with /var/log/ceph/ceph-client.admin.65854.log.gz 2023-08-23T04:21:45.194 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38795.log 2023-08-23T04:21:45.194 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69932.log.gz 2023-08-23T04:21:45.194 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63622.log 2023-08-23T04:21:45.194 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54821.log.gz 2023-08-23T04:21:45.194 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44483.log 2023-08-23T04:21:45.195 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38795.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38795.log.gz 2023-08-23T04:21:45.195 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57497.log 2023-08-23T04:21:45.195 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63622.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63622.log.gz 2023-08-23T04:21:45.195 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52259.log 2023-08-23T04:21:45.195 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44483.log.gz 2023-08-23T04:21:45.196 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75306.log 2023-08-23T04:21:45.196 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57497.log.gz 2023-08-23T04:21:45.196 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74102.log 2023-08-23T04:21:45.196 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52259.log.gz 2023-08-23T04:21:45.197 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72671.log 2023-08-23T04:21:45.197 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75306.log.gz 2023-08-23T04:21:45.197 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.74102.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43831.log 2023-08-23T04:21:45.197 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74102.log.gz 2023-08-23T04:21:45.197 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64250.log 2023-08-23T04:21:45.198 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72671.log.gz 2023-08-23T04:21:45.198 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72564.log 2023-08-23T04:21:45.198 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43831.log.gz 2023-08-23T04:21:45.198 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77405.log 2023-08-23T04:21:45.199 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64250.log.gz 2023-08-23T04:21:45.199 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.72564.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.71465.log 2023-08-23T04:21:45.199 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72564.log.gz 2023-08-23T04:21:45.199 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56650.log 2023-08-23T04:21:45.199 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77405.log.gz 2023-08-23T04:21:45.200 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79117.log 2023-08-23T04:21:45.200 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71465.log.gz 2023-08-23T04:21:45.200 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77630.log 2023-08-23T04:21:45.200 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56650.log.gz 2023-08-23T04:21:45.201 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69522.log 2023-08-23T04:21:45.201 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79117.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79117.log.gz 2023-08-23T04:21:45.201 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62349.log 2023-08-23T04:21:45.201 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77630.log.gz 2023-08-23T04:21:45.202 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74812.log 2023-08-23T04:21:45.202 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69522.log.gz 2023-08-23T04:21:45.202 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34792.log 2023-08-23T04:21:45.202 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62349.log.gz 2023-08-23T04:21:45.202 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42187.log 2023-08-23T04:21:45.203 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74812.log.gz 2023-08-23T04:21:45.203 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40308.log 2023-08-23T04:21:45.203 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34792.log.gz 2023-08-23T04:21:45.203 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79692.log 2023-08-23T04:21:45.204 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42187.log.gz 2023-08-23T04:21:45.204 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72957.log 2023-08-23T04:21:45.204 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40308.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40308.log.gz 2023-08-23T04:21:45.204 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.79692.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.67277.log 2023-08-23T04:21:45.205 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79692.log.gz 2023-08-23T04:21:45.205 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40172.log 2023-08-23T04:21:45.205 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72957.log.gz 2023-08-23T04:21:45.205 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66133.log 2023-08-23T04:21:45.205 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67277.log.gz 2023-08-23T04:21:45.206 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34213.log 2023-08-23T04:21:45.206 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40172.log.gz 2023-08-23T04:21:45.206 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69795.log 2023-08-23T04:21:45.206 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66133.log.gz 2023-08-23T04:21:45.206 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73436.log 2023-08-23T04:21:45.207 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34213.log.gz 2023-08-23T04:21:45.207 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33421.log 2023-08-23T04:21:45.207 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69795.log.gz 2023-08-23T04:21:45.207 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42447.log 2023-08-23T04:21:45.208 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73436.log.gz 2023-08-23T04:21:45.208 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44420.log 2023-08-23T04:21:45.208 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33421.log.gz 2023-08-23T04:21:45.208 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46079.log 2023-08-23T04:21:45.208 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42447.log.gz 2023-08-23T04:21:45.209 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38982.log 2023-08-23T04:21:45.209 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44420.log.gz 2023-08-23T04:21:45.209 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64752.log 2023-08-23T04:21:45.209 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46079.log.gz 2023-08-23T04:21:45.209 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36570.log 2023-08-23T04:21:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38982.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38982.log.gz 2023-08-23T04:21:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56392.log 2023-08-23T04:21:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64752.log.gz 2023-08-23T04:21:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45113.log 2023-08-23T04:21:45.210 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36570.log.gz 2023-08-23T04:21:45.211 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53454.log 2023-08-23T04:21:45.211 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56392.log.gz 2023-08-23T04:21:45.211 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64368.log 2023-08-23T04:21:45.211 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45113.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.45113.log.gz--verbose 2023-08-23T04:21:45.211 INFO:teuthology.orchestra.run.smithi012.stderr:-- /var/log/ceph/ceph-client.admin.35327.log 2023-08-23T04:21:45.212 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53454.log.gz 2023-08-23T04:21:45.212 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44903.log 2023-08-23T04:21:45.212 INFO:teuthology.orchestra.run.smithi012.stderr: 23.6% -- replaced with /var/log/ceph/ceph-client.admin.64368.log.gz 2023-08-23T04:21:45.212 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70253.log 2023-08-23T04:21:45.212 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35327.log.gz 2023-08-23T04:21:45.213 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78982.log 2023-08-23T04:21:45.213 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44903.log.gz 2023-08-23T04:21:45.213 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48183.log 2023-08-23T04:21:45.213 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70253.log.gz 2023-08-23T04:21:45.213 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65053.log 2023-08-23T04:21:45.214 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78982.log.gz 2023-08-23T04:21:45.214 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49262.log 2023-08-23T04:21:45.214 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48183.log.gz 2023-08-23T04:21:45.214 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.65053.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60841.log 2023-08-23T04:21:45.214 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65053.log.gz 2023-08-23T04:21:45.215 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57927.log 2023-08-23T04:21:45.215 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49262.log.gz 2023-08-23T04:21:45.215 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77388.log 2023-08-23T04:21:45.215 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60841.log.gz 2023-08-23T04:21:45.215 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57927.log: /var/log/ceph/ceph-client.admin.73457.log 2023-08-23T04:21:45.216 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57927.log.gz 2023-08-23T04:21:45.216 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76300.log 2023-08-23T04:21:45.216 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77388.log.gz 2023-08-23T04:21:45.216 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52280.log 2023-08-23T04:21:45.216 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73457.log.gz 2023-08-23T04:21:45.217 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54138.log 2023-08-23T04:21:45.217 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76300.log.gz 2023-08-23T04:21:45.217 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76278.log 2023-08-23T04:21:45.217 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52280.log.gz 2023-08-23T04:21:45.217 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34555.log 2023-08-23T04:21:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54138.log.gz 2023-08-23T04:21:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65814.log 2023-08-23T04:21:45.218 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76278.log.gz 2023-08-23T04:21:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42488.log 2023-08-23T04:21:45.218 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34555.log.gz 2023-08-23T04:21:45.219 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61703.log 2023-08-23T04:21:45.219 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65814.log.gz 2023-08-23T04:21:45.219 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77112.log 2023-08-23T04:21:45.219 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42488.log.gz 2023-08-23T04:21:45.220 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48497.log 2023-08-23T04:21:45.220 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61703.log.gz 2023-08-23T04:21:45.220 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64666.log 2023-08-23T04:21:45.220 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77112.log.gz 2023-08-23T04:21:45.220 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50227.log 2023-08-23T04:21:45.221 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48497.log: /var/log/ceph/ceph-client.admin.64666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41807.log 2023-08-23T04:21:45.221 INFO:teuthology.orchestra.run.smithi012.stderr: 55.9% -- replaced with /var/log/ceph/ceph-client.admin.48497.log.gz 2023-08-23T04:21:45.221 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64666.log.gz 2023-08-23T04:21:45.221 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49404.log 2023-08-23T04:21:45.221 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50227.log.gz 2023-08-23T04:21:45.222 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60634.log 2023-08-23T04:21:45.222 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41807.log.gz 2023-08-23T04:21:45.222 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52732.log 2023-08-23T04:21:45.222 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49404.log.gz 2023-08-23T04:21:45.222 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46912.log 2023-08-23T04:21:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55746.log 2023-08-23T04:21:45.223 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60634.log.gz 2023-08-23T04:21:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52732.log.gz 2023-08-23T04:21:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63751.log 2023-08-23T04:21:45.223 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46912.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46912.log.gz 2023-08-23T04:21:45.224 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58034.log 2023-08-23T04:21:45.224 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55746.log: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.55746.log.gz 2023-08-23T04:21:45.224 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.63751.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66868.log 2023-08-23T04:21:45.224 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63751.log.gz 2023-08-23T04:21:45.224 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50148.log 2023-08-23T04:21:45.225 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58034.log.gz 2023-08-23T04:21:45.225 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54779.log 2023-08-23T04:21:45.225 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66868.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66868.log.gz 2023-08-23T04:21:45.225 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37387.log 2023-08-23T04:21:45.225 INFO:teuthology.orchestra.run.smithi012.stderr: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.50148.log.gz 2023-08-23T04:21:45.226 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.54779.log: --verbose -- /var/log/ceph/ceph-client.admin.75999.log 2023-08-23T04:21:45.226 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54779.log.gz 2023-08-23T04:21:45.226 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41887.log 2023-08-23T04:21:45.226 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37387.log.gz 2023-08-23T04:21:45.226 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34034.log 2023-08-23T04:21:45.227 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75999.log.gz 2023-08-23T04:21:45.227 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65380.log 2023-08-23T04:21:45.227 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41887.log.gz 2023-08-23T04:21:45.227 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41867.log 2023-08-23T04:21:45.228 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34034.log.gz 2023-08-23T04:21:45.228 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60945.log 2023-08-23T04:21:45.228 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65380.log.gz 2023-08-23T04:21:45.228 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52173.log 2023-08-23T04:21:45.228 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41867.log.gz 2023-08-23T04:21:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48317.log 2023-08-23T04:21:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60945.log.gz 2023-08-23T04:21:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78739.log 2023-08-23T04:21:45.229 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52173.log.gz 2023-08-23T04:21:45.229 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41287.log 2023-08-23T04:21:45.230 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48317.log.gz 2023-08-23T04:21:45.230 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73866.log 2023-08-23T04:21:45.230 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78739.log.gz 2023-08-23T04:21:45.230 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68190.log 2023-08-23T04:21:45.231 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41287.log.gz 2023-08-23T04:21:45.231 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52796.log 2023-08-23T04:21:45.231 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73866.log.gz 2023-08-23T04:21:45.231 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42027.log 2023-08-23T04:21:45.231 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68190.log.gz 2023-08-23T04:21:45.232 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63089.log 2023-08-23T04:21:45.232 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52796.log.gz 2023-08-23T04:21:45.232 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75827.log 2023-08-23T04:21:45.232 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42027.log.gz 2023-08-23T04:21:45.232 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72895.log 2023-08-23T04:21:45.233 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63089.log.gz 2023-08-23T04:21:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59993.log 2023-08-23T04:21:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75827.log.gz 2023-08-23T04:21:45.233 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60905.log 2023-08-23T04:21:45.233 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72895.log.gz 2023-08-23T04:21:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34092.log 2023-08-23T04:21:45.234 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59993.log.gz 2023-08-23T04:21:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73758.log 2023-08-23T04:21:45.234 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60905.log.gz 2023-08-23T04:21:45.235 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73201.log 2023-08-23T04:21:45.235 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34092.log.gz 2023-08-23T04:21:45.235 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34771.log 2023-08-23T04:21:45.235 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73758.log.gz 2023-08-23T04:21:45.235 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77284.log 2023-08-23T04:21:45.236 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73201.log.gz 2023-08-23T04:21:45.236 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63514.log 2023-08-23T04:21:45.236 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34771.log.gz 2023-08-23T04:21:45.236 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64988.log 2023-08-23T04:21:45.236 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77284.log.gz 2023-08-23T04:21:45.237 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76429.log 2023-08-23T04:21:45.237 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63514.log.gz 2023-08-23T04:21:45.237 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46740.log 2023-08-23T04:21:45.238 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64988.log.gz 2023-08-23T04:21:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55490.log 2023-08-23T04:21:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76429.log.gz 2023-08-23T04:21:45.238 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79090.log 2023-08-23T04:21:45.239 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46740.log.gz 2023-08-23T04:21:45.239 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67148.log 2023-08-23T04:21:45.239 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55490.log.gz 2023-08-23T04:21:45.239 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69875.log 2023-08-23T04:21:45.239 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79090.log.gz 2023-08-23T04:21:45.240 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32641.log 2023-08-23T04:21:45.240 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67148.log.gz 2023-08-23T04:21:45.240 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79174.log 2023-08-23T04:21:45.240 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69875.log.gz 2023-08-23T04:21:45.240 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32641.log: /var/log/ceph/ceph-client.admin.73780.log 2023-08-23T04:21:45.241 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32641.log.gz 2023-08-23T04:21:45.241 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76343.log 2023-08-23T04:21:45.241 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79174.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79174.log.gz 2023-08-23T04:21:45.241 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.73780.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.44630.log 2023-08-23T04:21:45.241 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73780.log.gz 2023-08-23T04:21:45.242 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68307.log 2023-08-23T04:21:45.242 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76343.log.gz 2023-08-23T04:21:45.242 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74951.log 2023-08-23T04:21:45.242 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44630.log.gz 2023-08-23T04:21:45.242 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33572.log 2023-08-23T04:21:45.243 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68307.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68307.log.gz 2023-08-23T04:21:45.243 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43780.log 2023-08-23T04:21:45.243 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74951.log.gz 2023-08-23T04:21:45.243 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42207.log 2023-08-23T04:21:45.243 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33572.log.gz 2023-08-23T04:21:45.244 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36506.log 2023-08-23T04:21:45.244 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43780.log.gz 2023-08-23T04:21:45.244 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.42207.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37366.log 2023-08-23T04:21:45.244 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42207.log.gz 2023-08-23T04:21:45.244 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58077.log 2023-08-23T04:21:45.245 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36506.log.gz 2023-08-23T04:21:45.245 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77262.log 2023-08-23T04:21:45.245 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37366.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37366.log.gz 2023-08-23T04:21:45.245 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35198.log 2023-08-23T04:21:45.245 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58077.log.gz 2023-08-23T04:21:45.246 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40987.log 2023-08-23T04:21:45.246 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77262.log.gz 2023-08-23T04:21:45.246 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71704.log 2023-08-23T04:21:45.246 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35198.log.gz 2023-08-23T04:21:45.246 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36914.log 2023-08-23T04:21:45.247 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40987.log.gz 2023-08-23T04:21:45.247 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43406.log 2023-08-23T04:21:45.247 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71704.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71704.log.gz 2023-08-23T04:21:45.247 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38056.log 2023-08-23T04:21:45.247 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36914.log.gz 2023-08-23T04:21:45.248 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65775.log 2023-08-23T04:21:45.248 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43406.log.gz 2023-08-23T04:21:45.248 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33051.log 2023-08-23T04:21:45.248 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38056.log.gz 2023-08-23T04:21:45.249 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70507.log 2023-08-23T04:21:45.249 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65775.log.gz 2023-08-23T04:21:45.249 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53031.log 2023-08-23T04:21:45.249 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33051.log.gz 2023-08-23T04:21:45.249 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70192.log 2023-08-23T04:21:45.250 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70507.log.gz 2023-08-23T04:21:45.250 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72220.log 2023-08-23T04:21:45.250 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53031.log.gz 2023-08-23T04:21:45.250 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77422.log 2023-08-23T04:21:45.250 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70192.log: /var/log/ceph/ceph-client.admin.72220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70192.log.gz 2023-08-23T04:21:45.251 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76192.log 2023-08-23T04:21:45.251 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72220.log.gz 2023-08-23T04:21:45.251 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40036.log 2023-08-23T04:21:45.251 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77422.log.gz 2023-08-23T04:21:45.251 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62005.log 2023-08-23T04:21:45.252 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76192.log.gz 2023-08-23T04:21:45.252 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59821.log 2023-08-23T04:21:45.252 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40036.log: gzip 1.2%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.40036.log.gz-- 2023-08-23T04:21:45.252 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70232.log 2023-08-23T04:21:45.252 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62005.log: /var/log/ceph/ceph-client.admin.59821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78251.log 2023-08-23T04:21:45.253 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62005.log.gz 2023-08-23T04:21:45.253 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59821.log.gz 2023-08-23T04:21:45.253 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75514.log 2023-08-23T04:21:45.253 INFO:teuthology.orchestra.run.smithi012.stderr: 51.5% -- replaced with /var/log/ceph/ceph-client.admin.70232.log.gz 2023-08-23T04:21:45.254 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77981.log 2023-08-23T04:21:45.254 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78251.log.gz 2023-08-23T04:21:45.254 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67964.log 2023-08-23T04:21:45.254 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75514.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75514.log.gz 2023-08-23T04:21:45.254 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69283.log 2023-08-23T04:21:45.255 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77981.log.gz 2023-08-23T04:21:45.255 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34875.log 2023-08-23T04:21:45.255 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67964.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67964.log.gz 2023-08-23T04:21:45.255 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51868.log 2023-08-23T04:21:45.255 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69283.log.gz 2023-08-23T04:21:45.256 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43576.log 2023-08-23T04:21:45.256 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34875.log.gz 2023-08-23T04:21:45.256 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50946.log 2023-08-23T04:21:45.256 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51868.log.gz 2023-08-23T04:21:45.256 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36077.log 2023-08-23T04:21:45.257 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43576.log.gz 2023-08-23T04:21:45.257 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70407.log 2023-08-23T04:21:45.257 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50946.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50946.log.gz 2023-08-23T04:21:45.257 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49303.log 2023-08-23T04:21:45.257 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36077.log.gz 2023-08-23T04:21:45.258 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49020.log 2023-08-23T04:21:45.258 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73414.log 2023-08-23T04:21:45.258 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70407.log.gz 2023-08-23T04:21:45.258 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49303.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49303.log.gz 2023-08-23T04:21:45.258 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62499.log 2023-08-23T04:21:45.259 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49020.log.gz 2023-08-23T04:21:45.259 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-08-23T04:21:45.259 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73414.log: 56.1% -- replaced with /var/log/ceph/ceph-client.admin.73414.log.gz 2023-08-23T04:21:45.259 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70545.log 2023-08-23T04:21:45.259 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62499.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.43661.log 2023-08-23T04:21:45.260 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62499.log.gz 2023-08-23T04:21:45.260 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41147.log 2023-08-23T04:21:45.260 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70545.log.gz 2023-08-23T04:21:45.260 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.43661.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.42505.log 2023-08-23T04:21:45.261 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43661.log.gz 2023-08-23T04:21:45.261 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.41147.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46482.log 2023-08-23T04:21:45.261 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41147.log.gz 2023-08-23T04:21:45.261 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76257.log 2023-08-23T04:21:45.261 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42505.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42505.log.gz 2023-08-23T04:21:45.261 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36893.log 2023-08-23T04:21:45.262 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46482.log.gz 2023-08-23T04:21:45.262 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42287.log 2023-08-23T04:21:45.262 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76257.log.gz 2023-08-23T04:21:45.262 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36893.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.62859.log -- replaced with /var/log/ceph/ceph-client.admin.36893.log.gz 2023-08-23T04:21:45.262 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:21:45.263 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59434.log 2023-08-23T04:21:45.263 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42287.log.gz 2023-08-23T04:21:45.263 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62284.log 2023-08-23T04:21:45.263 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62859.log.gz 2023-08-23T04:21:45.264 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77711.log 2023-08-23T04:21:45.264 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59434.log.gz 2023-08-23T04:21:45.264 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.62284.log: -- /var/log/ceph/ceph-client.admin.66069.log 2023-08-23T04:21:45.264 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62284.log.gz 2023-08-23T04:21:45.264 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35391.log 2023-08-23T04:21:45.265 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77711.log.gz 2023-08-23T04:21:45.265 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79503.log 2023-08-23T04:21:45.265 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66069.log.gz 2023-08-23T04:21:45.265 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70996.log 2023-08-23T04:21:45.265 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35391.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35391.log.gz 2023-08-23T04:21:45.266 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47689.log 2023-08-23T04:21:45.266 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79503.log.gz 2023-08-23T04:21:45.266 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56026.log 2023-08-23T04:21:45.266 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70996.log.gz 2023-08-23T04:21:45.266 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76725.log 2023-08-23T04:21:45.267 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47689.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47689.log.gz-5 2023-08-23T04:21:45.267 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.74317.log 2023-08-23T04:21:45.267 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56026.log.gz 2023-08-23T04:21:45.267 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70585.log 2023-08-23T04:21:45.267 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76725.log.gz 2023-08-23T04:21:45.268 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.74317.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.73909.log 2023-08-23T04:21:45.268 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74317.log.gz 2023-08-23T04:21:45.268 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77926.log 2023-08-23T04:21:45.268 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70585.log.gz 2023-08-23T04:21:45.268 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75532.log 2023-08-23T04:21:45.269 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73909.log.gz 2023-08-23T04:21:45.269 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55640.log 2023-08-23T04:21:45.269 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77926.log.gz 2023-08-23T04:21:45.269 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63256.log 2023-08-23T04:21:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75532.log: 55.9% -- replaced with /var/log/ceph/ceph-client.admin.75532.log.gz 2023-08-23T04:21:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67406.log 2023-08-23T04:21:45.270 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55640.log.gz 2023-08-23T04:21:45.270 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36292.log 2023-08-23T04:21:45.270 INFO:teuthology.orchestra.run.smithi012.stderr: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.63256.log.gz 2023-08-23T04:21:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65420.log 2023-08-23T04:21:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67406.log.gz 2023-08-23T04:21:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37258.log 2023-08-23T04:21:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36292.log.gz 2023-08-23T04:21:45.271 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74446.log 2023-08-23T04:21:45.272 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65420.log.gz 2023-08-23T04:21:45.272 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48334.log 2023-08-23T04:21:45.272 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37258.log.gz 2023-08-23T04:21:45.272 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43814.log 2023-08-23T04:21:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74446.log.gz 2023-08-23T04:21:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35262.log 2023-08-23T04:21:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48334.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.48334.log.gz 2023-08-23T04:21:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72729.log 2023-08-23T04:21:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43814.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.43814.log.gz--verbose 2023-08-23T04:21:45.273 INFO:teuthology.orchestra.run.smithi012.stderr:-- /var/log/ceph/ceph-client.admin.43933.log 2023-08-23T04:21:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35262.log.gz 2023-08-23T04:21:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62736.log 2023-08-23T04:21:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72729.log.gz 2023-08-23T04:21:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43389.log 2023-08-23T04:21:45.274 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43933.log.gz 2023-08-23T04:21:45.275 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.62736.log: -- /var/log/ceph/ceph-client.admin.67556.log 2023-08-23T04:21:45.275 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62736.log.gz 2023-08-23T04:21:45.275 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54095.log 2023-08-23T04:21:45.275 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43389.log.gz 2023-08-23T04:21:45.275 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69969.log 2023-08-23T04:21:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67556.log.gz 2023-08-23T04:21:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72284.log 2023-08-23T04:21:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54095.log.gz 2023-08-23T04:21:45.276 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.69969.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36227.log 2023-08-23T04:21:45.277 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69969.log.gz 2023-08-23T04:21:45.277 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50465.log 2023-08-23T04:21:45.277 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72284.log.gz 2023-08-23T04:21:45.277 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34271.log 2023-08-23T04:21:45.277 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36227.log.gz 2023-08-23T04:21:45.278 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46525.log 2023-08-23T04:21:45.278 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50465.log.gz 2023-08-23T04:21:45.278 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43219.log 2023-08-23T04:21:45.278 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34271.log.gz 2023-08-23T04:21:45.278 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61466.log 2023-08-23T04:21:45.278 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46525.log.gz 2023-08-23T04:21:45.279 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50350.log 2023-08-23T04:21:45.279 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43219.log.gz 2023-08-23T04:21:45.279 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44567.log 2023-08-23T04:21:45.279 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61466.log.gz 2023-08-23T04:21:45.279 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43610.log 2023-08-23T04:21:45.280 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.50350.log.gz 2023-08-23T04:21:45.280 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40547.log 2023-08-23T04:21:45.280 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44567.log.gz 2023-08-23T04:21:45.280 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.43610.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35413.log 2023-08-23T04:21:45.281 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43610.log.gz 2023-08-23T04:21:45.281 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55832.log 2023-08-23T04:21:45.281 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40547.log.gz 2023-08-23T04:21:45.281 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38507.log 2023-08-23T04:21:45.281 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35413.log.gz 2023-08-23T04:21:45.282 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54930.log 2023-08-23T04:21:45.282 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55832.log.gz 2023-08-23T04:21:45.282 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.38507.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35862.log 2023-08-23T04:21:45.282 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38507.log.gz 2023-08-23T04:21:45.282 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60207.log 2023-08-23T04:21:45.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54930.log.gz 2023-08-23T04:21:45.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47861.log 2023-08-23T04:21:45.283 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35862.log.gz 2023-08-23T04:21:45.283 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66567.log 2023-08-23T04:21:45.283 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60207.log.gz 2023-08-23T04:21:45.284 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48720.log 2023-08-23T04:21:45.284 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47861.log.gz 2023-08-23T04:21:45.284 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67599.log 2023-08-23T04:21:45.284 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66567.log.gz 2023-08-23T04:21:45.284 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33357.log 2023-08-23T04:21:45.285 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74425.log 2023-08-23T04:21:45.285 INFO:teuthology.orchestra.run.smithi012.stderr: 22.4%/var/log/ceph/ceph-client.admin.67599.log: -- replaced with /var/log/ceph/ceph-client.admin.48720.log.gz 2023-08-23T04:21:45.285 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0%/var/log/ceph/ceph-client.admin.33357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67983.log 2023-08-23T04:21:45.285 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67599.log.gz 2023-08-23T04:21:45.285 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33357.log.gz 2023-08-23T04:21:45.286 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61531.log 2023-08-23T04:21:45.286 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74425.log.gz 2023-08-23T04:21:45.286 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57389.log 2023-08-23T04:21:45.286 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67983.log.gz 2023-08-23T04:21:45.286 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61531.log.gz 2023-08-23T04:21:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55427.log 2023-08-23T04:21:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48372.log 2023-08-23T04:21:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57389.log.gz 2023-08-23T04:21:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48269.log 2023-08-23T04:21:45.287 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55427.log.gz 2023-08-23T04:21:45.288 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72830.log 2023-08-23T04:21:45.288 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48372.log.gz 2023-08-23T04:21:45.288 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48269.log.gz 2023-08-23T04:21:45.288 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74991.log 2023-08-23T04:21:45.289 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65735.log 2023-08-23T04:21:45.289 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72830.log.gz 2023-08-23T04:21:45.289 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53600.log 2023-08-23T04:21:45.289 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74991.log.gz 2023-08-23T04:21:45.289 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.65735.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.74489.log 2023-08-23T04:21:45.290 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65735.log.gz 2023-08-23T04:21:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37323.log 2023-08-23T04:21:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53600.log.gz 2023-08-23T04:21:45.290 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65639.log 2023-08-23T04:21:45.290 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74489.log.gz 2023-08-23T04:21:45.291 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56414.log 2023-08-23T04:21:45.291 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37323.log.gz 2023-08-23T04:21:45.291 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.65639.log: --verbose -- /var/log/ceph/ceph-client.admin.46783.log 2023-08-23T04:21:45.291 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65639.log.gz 2023-08-23T04:21:45.291 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46396.log 2023-08-23T04:21:45.292 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56414.log.gz 2023-08-23T04:21:45.292 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46783.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.46783.log.gz-5 2023-08-23T04:21:45.292 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.35585.log 2023-08-23T04:21:45.292 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34593.log 2023-08-23T04:21:45.292 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46396.log.gz 2023-08-23T04:21:45.293 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67320.log 2023-08-23T04:21:45.293 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35585.log.gz 2023-08-23T04:21:45.293 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39747.log 2023-08-23T04:21:45.293 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34593.log.gz 2023-08-23T04:21:45.293 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.67320.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.71565.log 2023-08-23T04:21:45.294 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67320.log.gz 2023-08-23T04:21:45.294 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78089.log 2023-08-23T04:21:45.294 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39747.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39747.log.gz 2023-08-23T04:21:45.294 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77219.log 2023-08-23T04:21:45.294 INFO:teuthology.orchestra.run.smithi012.stderr: 51.3% -- replaced with /var/log/ceph/ceph-client.admin.71565.log.gz 2023-08-23T04:21:45.295 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44336.log 2023-08-23T04:21:45.295 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78089.log.gz 2023-08-23T04:21:45.295 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77684.log 2023-08-23T04:21:45.295 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77219.log.gz 2023-08-23T04:21:45.295 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53379.log 2023-08-23T04:21:45.296 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44336.log.gz 2023-08-23T04:21:45.296 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45323.log 2023-08-23T04:21:45.296 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77684.log.gz 2023-08-23T04:21:45.296 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50367.log 2023-08-23T04:21:45.297 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53379.log.gz 2023-08-23T04:21:45.297 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33851.log 2023-08-23T04:21:45.297 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45323.log.gz 2023-08-23T04:21:45.297 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47925.log 2023-08-23T04:21:45.297 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50367.log: 31.5% -- replaced with /var/log/ceph/ceph-client.admin.50367.log.gz 2023-08-23T04:21:45.298 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.33851.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60247.log 2023-08-23T04:21:45.298 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33851.log.gz 2023-08-23T04:21:45.298 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32722.log 2023-08-23T04:21:45.298 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47925.log.gz 2023-08-23T04:21:45.298 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48351.log 2023-08-23T04:21:45.298 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60247.log.gz 2023-08-23T04:21:45.299 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.32722.log: --verbose -- /var/log/ceph/ceph-client.admin.62327.log 2023-08-23T04:21:45.299 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32722.log.gz 2023-08-23T04:21:45.299 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39135.log 2023-08-23T04:21:45.299 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48351.log.gz 2023-08-23T04:21:45.299 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.62327.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66193.log 2023-08-23T04:21:45.300 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62327.log.gz 2023-08-23T04:21:45.300 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63987.log 2023-08-23T04:21:45.300 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39135.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39135.log.gz 2023-08-23T04:21:45.300 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66193.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.66193.log.gz-5 2023-08-23T04:21:45.301 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.46633.log 2023-08-23T04:21:45.301 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66954.log 2023-08-23T04:21:45.301 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63987.log.gz 2023-08-23T04:21:45.301 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46205.log 2023-08-23T04:21:45.301 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46633.log.gz 2023-08-23T04:21:45.302 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41567.log 2023-08-23T04:21:45.302 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66954.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33271.log 2023-08-23T04:21:45.302 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.66954.log.gz 2023-08-23T04:21:45.302 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46205.log.gz 2023-08-23T04:21:45.302 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46037.log 2023-08-23T04:21:45.303 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41567.log.gz 2023-08-23T04:21:45.303 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34706.log 2023-08-23T04:21:45.303 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33271.log.gz 2023-08-23T04:21:45.303 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74891.log 2023-08-23T04:21:45.303 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46037.log.gz 2023-08-23T04:21:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68116.log 2023-08-23T04:21:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34706.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.34706.log.gz-5 2023-08-23T04:21:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.61128.log 2023-08-23T04:21:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74891.log: 13.6% -- replaced with /var/log/ceph/ceph-client.admin.74891.log.gz 2023-08-23T04:21:45.304 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54159.log 2023-08-23T04:21:45.305 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68116.log.gz 2023-08-23T04:21:45.305 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34327.log 2023-08-23T04:21:45.305 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61128.log.gz 2023-08-23T04:21:45.305 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73887.log 2023-08-23T04:21:45.305 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54159.log.gz 2023-08-23T04:21:45.306 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59885.log 2023-08-23T04:21:45.306 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34327.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34327.log.gz 2023-08-23T04:21:45.306 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39118.log 2023-08-23T04:21:45.306 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73887.log.gz 2023-08-23T04:21:45.306 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55918.log 2023-08-23T04:21:45.307 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59885.log.gz 2023-08-23T04:21:45.307 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62048.log 2023-08-23T04:21:45.307 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39118.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39118.log.gz 2023-08-23T04:21:45.307 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56822.log 2023-08-23T04:21:45.307 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55918.log.gz 2023-08-23T04:21:45.308 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68211.log 2023-08-23T04:21:45.308 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62048.log.gz 2023-08-23T04:21:45.308 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51653.log 2023-08-23T04:21:45.308 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56822.log.gz 2023-08-23T04:21:45.308 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66008.log 2023-08-23T04:21:45.309 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68211.log.gz 2023-08-23T04:21:45.309 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66718.log 2023-08-23T04:21:45.309 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51653.log.gz 2023-08-23T04:21:45.309 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71586.log 2023-08-23T04:21:45.309 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66008.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66008.log.gz 2023-08-23T04:21:45.310 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66233.log 2023-08-23T04:21:45.310 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66718.log.gz 2023-08-23T04:21:45.310 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37237.log 2023-08-23T04:21:45.310 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71586.log.gz 2023-08-23T04:21:45.310 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45491.log 2023-08-23T04:21:45.311 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66233.log.gz 2023-08-23T04:21:45.311 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66337.log 2023-08-23T04:21:45.311 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37237.log.gz 2023-08-23T04:21:45.311 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71288.log 2023-08-23T04:21:45.311 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45491.log: 22.0% -- replaced with /var/log/ceph/ceph-client.admin.45491.log.gz 2023-08-23T04:21:45.312 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53206.log 2023-08-23T04:21:45.312 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66337.log.gz 2023-08-23T04:21:45.312 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35499.log 2023-08-23T04:21:45.312 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71288.log.gz 2023-08-23T04:21:45.312 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48820.log 2023-08-23T04:21:45.313 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53206.log.gz 2023-08-23T04:21:45.313 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68000.log 2023-08-23T04:21:45.313 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35499.log.gz 2023-08-23T04:21:45.313 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44882.log 2023-08-23T04:21:45.313 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48820.log.gz 2023-08-23T04:21:45.314 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72263.log 2023-08-23T04:21:45.314 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68000.log.gz 2023-08-23T04:21:45.314 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45764.log 2023-08-23T04:21:45.314 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44882.log.gz 2023-08-23T04:21:45.314 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71325.log 2023-08-23T04:21:45.315 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72263.log.gz 2023-08-23T04:21:45.315 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52926.log 2023-08-23T04:21:45.315 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45764.log.gz 2023-08-23T04:21:45.315 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37665.log 2023-08-23T04:21:45.315 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71325.log.gz 2023-08-23T04:21:45.316 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63450.log 2023-08-23T04:21:45.316 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52926.log.gz 2023-08-23T04:21:45.316 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75285.log 2023-08-23T04:21:45.316 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37665.log.gz 2023-08-23T04:21:45.317 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66933.log 2023-08-23T04:21:45.317 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63450.log.gz 2023-08-23T04:21:45.317 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.25902.log 2023-08-23T04:21:45.317 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75285.log: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.75285.log.gz 2023-08-23T04:21:45.317 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70312.log 2023-08-23T04:21:45.318 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66933.log.gz 2023-08-23T04:21:45.318 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph.tmp-client.admin.25902.log: --verbose -- /var/log/ceph/ceph-client.admin.34251.log 2023-08-23T04:21:45.318 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.25902.log.gz 2023-08-23T04:21:45.318 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65139.log 2023-08-23T04:21:45.319 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70312.log: 56.9% -- replaced with /var/log/ceph/ceph-client.admin.70312.log.gz 2023-08-23T04:21:45.319 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66395.log 2023-08-23T04:21:45.319 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34251.log.gz 2023-08-23T04:21:45.319 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68076.log 2023-08-23T04:21:45.319 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65139.log.gz 2023-08-23T04:21:45.320 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77176.log 2023-08-23T04:21:45.320 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61108.log 2023-08-23T04:21:45.320 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66395.log.gz 2023-08-23T04:21:45.320 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39679.log 2023-08-23T04:21:45.320 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68076.log.gz 2023-08-23T04:21:45.321 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77176.log.gz 2023-08-23T04:21:45.321 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77133.log 2023-08-23T04:21:45.321 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61108.log.gz 2023-08-23T04:21:45.321 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69220.log 2023-08-23T04:21:45.321 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39679.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39679.log.gz 2023-08-23T04:21:45.322 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45449.log 2023-08-23T04:21:45.322 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77133.log.gz 2023-08-23T04:21:45.322 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72521.log 2023-08-23T04:21:45.322 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69220.log.gz 2023-08-23T04:21:45.322 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71761.log 2023-08-23T04:21:45.323 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45449.log.gz 2023-08-23T04:21:45.323 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37970.log 2023-08-23T04:21:45.323 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72521.log.gz 2023-08-23T04:21:45.323 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42227.log 2023-08-23T04:21:45.323 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71761.log.gz 2023-08-23T04:21:45.324 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77026.log 2023-08-23T04:21:45.324 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37970.log.gz 2023-08-23T04:21:45.324 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64773.log 2023-08-23T04:21:45.324 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42227.log.gz 2023-08-23T04:21:45.324 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29641.log 2023-08-23T04:21:45.325 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77026.log.gz 2023-08-23T04:21:45.325 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52237.log 2023-08-23T04:21:45.325 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64773.log.gz 2023-08-23T04:21:45.325 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55074.log 2023-08-23T04:21:45.325 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.29641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29641.log.gz 2023-08-23T04:21:45.326 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69161.log 2023-08-23T04:21:45.326 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52237.log.gz 2023-08-23T04:21:45.326 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63130.log 2023-08-23T04:21:45.326 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55074.log.gz 2023-08-23T04:21:45.326 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57712.log 2023-08-23T04:21:45.327 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69161.log.gz 2023-08-23T04:21:45.327 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41247.log 2023-08-23T04:21:45.327 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63130.log.gz 2023-08-23T04:21:45.327 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66213.log 2023-08-23T04:21:45.327 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57712.log.gz 2023-08-23T04:21:45.328 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68579.log 2023-08-23T04:21:45.328 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41247.log.gz 2023-08-23T04:21:45.328 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71192.log 2023-08-23T04:21:45.328 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66213.log.gz 2023-08-23T04:21:45.329 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51825.log 2023-08-23T04:21:45.329 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68579.log.gz 2023-08-23T04:21:45.329 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48837.log 2023-08-23T04:21:45.329 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71192.log.gz 2023-08-23T04:21:45.329 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38778.log 2023-08-23T04:21:45.330 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51825.log.gz 2023-08-23T04:21:45.330 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54314.log 2023-08-23T04:21:45.330 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48837.log.gz 2023-08-23T04:21:45.330 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40121.log 2023-08-23T04:21:45.330 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38778.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38778.log.gz 2023-08-23T04:21:45.331 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79147.log 2023-08-23T04:21:45.331 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54314.log.gz 2023-08-23T04:21:45.331 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43474.log 2023-08-23T04:21:45.331 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40121.log.gz 2023-08-23T04:21:45.331 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63236.log 2023-08-23T04:21:45.332 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79147.log.gz 2023-08-23T04:21:45.332 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63686.log 2023-08-23T04:21:45.332 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43474.log.gz 2023-08-23T04:21:45.332 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37838.log 2023-08-23T04:21:45.332 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63236.log.gz 2023-08-23T04:21:45.333 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63686.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63686.log.gz-5 2023-08-23T04:21:45.333 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.47624.log 2023-08-23T04:21:45.333 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47063.log 2023-08-23T04:21:45.333 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37838.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37838.log.gz 2023-08-23T04:21:45.333 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43746.log 2023-08-23T04:21:45.334 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47624.log.gz 2023-08-23T04:21:45.334 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50008.log 2023-08-23T04:21:45.334 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47063.log.gz 2023-08-23T04:21:45.334 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42522.log 2023-08-23T04:21:45.334 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43746.log.gz 2023-08-23T04:21:45.335 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33314.log 2023-08-23T04:21:45.335 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50008.log: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.50008.log.gz 2023-08-23T04:21:45.335 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58098.log 2023-08-23T04:21:45.335 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42522.log.gz 2023-08-23T04:21:45.335 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51761.log 2023-08-23T04:21:45.336 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33314.log.gz 2023-08-23T04:21:45.336 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47990.log 2023-08-23T04:21:45.336 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.58098.log: 3.8% -- replaced with /var/log/ceph/ceph-client.admin.58098.log.gz 2023-08-23T04:21:45.336 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34611.log 2023-08-23T04:21:45.336 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36120.log 2023-08-23T04:21:45.337 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51761.log.gz 2023-08-23T04:21:45.337 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47990.log: /var/log/ceph/ceph-client.admin.34611.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.47990.log.gz-- 2023-08-23T04:21:45.337 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63193.log 2023-08-23T04:21:45.337 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34611.log.gz 2023-08-23T04:21:45.337 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51109.log 2023-08-23T04:21:45.338 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36120.log.gz 2023-08-23T04:21:45.338 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63193.log.gz 2023-08-23T04:21:45.338 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44086.log 2023-08-23T04:21:45.338 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42641.log 2023-08-23T04:21:45.338 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51109.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56500.log 2023-08-23T04:21:45.339 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51109.log.gz 2023-08-23T04:21:45.339 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44086.log: /var/log/ceph/ceph-client.admin.42641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37494.log 2023-08-23T04:21:45.339 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44086.log.gz 2023-08-23T04:21:45.339 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42641.log.gz 2023-08-23T04:21:45.339 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51226.log 2023-08-23T04:21:45.340 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56500.log.gz 2023-08-23T04:21:45.340 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66092.log 2023-08-23T04:21:45.340 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75364.log 2023-08-23T04:21:45.340 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.37494.log.gz 2023-08-23T04:21:45.340 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79665.log 2023-08-23T04:21:45.341 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66092.log: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.51226.log.gz 2023-08-23T04:21:45.341 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66092.log.gz 2023-08-23T04:21:45.341 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38679.log 2023-08-23T04:21:45.341 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75364.log.gz 2023-08-23T04:21:45.341 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54030.log 2023-08-23T04:21:45.342 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79665.log: /var/log/ceph/ceph-client.admin.38679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79665.log.gz 2023-08-23T04:21:45.342 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38679.log.gz 2023-08-23T04:21:45.342 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33163.log 2023-08-23T04:21:45.342 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32371.log 2023-08-23T04:21:45.342 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54030.log.gz 2023-08-23T04:21:45.343 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62628.log 2023-08-23T04:21:45.343 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33163.log.gz 2023-08-23T04:21:45.343 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42777.log 2023-08-23T04:21:45.343 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32371.log.gz 2023-08-23T04:21:45.344 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47796.log 2023-08-23T04:21:45.344 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62628.log.gz 2023-08-23T04:21:45.344 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38829.log 2023-08-23T04:21:45.344 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42777.log.gz 2023-08-23T04:21:45.344 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45155.log 2023-08-23T04:21:45.345 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47796.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47796.log.gz 2023-08-23T04:21:45.345 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63407.log 2023-08-23T04:21:45.345 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38829.log.gz 2023-08-23T04:21:45.345 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60821.log 2023-08-23T04:21:45.345 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz 2023-08-23T04:21:45.346 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.63407.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.55725.log 2023-08-23T04:21:45.346 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63407.log.gz 2023-08-23T04:21:45.346 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62478.log 2023-08-23T04:21:45.346 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60821.log.gz 2023-08-23T04:21:45.346 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48900.log 2023-08-23T04:21:45.347 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55725.log.gz 2023-08-23T04:21:45.347 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74726.log 2023-08-23T04:21:45.347 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62478.log.gz 2023-08-23T04:21:45.347 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72709.log 2023-08-23T04:21:45.347 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48900.log.gz 2023-08-23T04:21:45.348 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73995.log 2023-08-23T04:21:45.348 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74726.log.gz 2023-08-23T04:21:45.348 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40342.log 2023-08-23T04:21:45.348 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72709.log.gz 2023-08-23T04:21:45.349 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77047.log 2023-08-23T04:21:45.349 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73995.log.gz 2023-08-23T04:21:45.349 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67750.log 2023-08-23T04:21:45.349 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40342.log: /var/log/ceph/ceph-client.admin.77047.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40342.log.gz 2023-08-23T04:21:45.349 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77047.log.gz 2023-08-23T04:21:45.350 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51331.log 2023-08-23T04:21:45.350 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59287.log 2023-08-23T04:21:45.350 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67750.log.gz 2023-08-23T04:21:45.350 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45344.log 2023-08-23T04:21:45.350 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51331.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51331.log.gz 2023-08-23T04:21:45.351 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45092.log 2023-08-23T04:21:45.351 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46998.log 2023-08-23T04:21:45.351 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45344.log: 54.9% -- replaced with /var/log/ceph/ceph-client.admin.59287.log.gz 2023-08-23T04:21:45.351 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45344.log.gz 2023-08-23T04:21:45.351 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34631.log 2023-08-23T04:21:45.352 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45092.log: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.45092.log.gz 2023-08-23T04:21:45.352 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40707.log 2023-08-23T04:21:45.352 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46998.log.gz 2023-08-23T04:21:45.352 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78468.log 2023-08-23T04:21:45.352 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34631.log.gz 2023-08-23T04:21:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68948.log 2023-08-23T04:21:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40707.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40707.log.gz 2023-08-23T04:21:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65096.log 2023-08-23T04:21:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78468.log.gz 2023-08-23T04:21:45.353 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67427.log 2023-08-23T04:21:45.354 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68948.log.gz 2023-08-23T04:21:45.354 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56989.log 2023-08-23T04:21:45.354 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65096.log.gz 2023-08-23T04:21:45.354 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52907.log 2023-08-23T04:21:45.354 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67427.log.gz 2023-08-23T04:21:45.355 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64088.log 2023-08-23T04:21:45.355 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56989.log.gz 2023-08-23T04:21:45.355 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.52907.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.47475.log 2023-08-23T04:21:45.355 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52907.log.gz 2023-08-23T04:21:45.355 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35520.log 2023-08-23T04:21:45.356 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64088.log.gz 2023-08-23T04:21:45.356 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72435.log 2023-08-23T04:21:45.356 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47475.log.gz 2023-08-23T04:21:45.356 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.35520.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32906.log 2023-08-23T04:21:45.356 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35520.log.gz 2023-08-23T04:21:45.357 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44945.log 2023-08-23T04:21:45.357 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72435.log.gz 2023-08-23T04:21:45.357 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70566.log 2023-08-23T04:21:45.357 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32906.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32906.log.gz 2023-08-23T04:21:45.357 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54556.log 2023-08-23T04:21:45.358 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44945.log.gz 2023-08-23T04:21:45.358 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38897.log 2023-08-23T04:21:45.358 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70566.log.gz 2023-08-23T04:21:45.358 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63901.log 2023-08-23T04:21:45.358 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54556.log.gz 2023-08-23T04:21:45.359 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45890.log 2023-08-23T04:21:45.359 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38897.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38897.log.gz 2023-08-23T04:21:45.359 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42590.log 2023-08-23T04:21:45.359 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40927.log 2023-08-23T04:21:45.359 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63901.log.gz 2023-08-23T04:21:45.360 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45890.log.gz 2023-08-23T04:21:45.360 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59907.log 2023-08-23T04:21:45.360 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42590.log.gz 2023-08-23T04:21:45.360 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61402.log 2023-08-23T04:21:45.360 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40927.log.gz 2023-08-23T04:21:45.361 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62817.log 2023-08-23T04:21:45.361 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59907.log.gz 2023-08-23T04:21:45.361 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73801.log 2023-08-23T04:21:45.361 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61402.log.gz 2023-08-23T04:21:45.361 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62456.log 2023-08-23T04:21:45.362 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62817.log.gz 2023-08-23T04:21:45.362 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71840.log 2023-08-23T04:21:45.362 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73801.log.gz 2023-08-23T04:21:45.362 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36699.log 2023-08-23T04:21:45.362 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62456.log.gz 2023-08-23T04:21:45.363 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63815.log 2023-08-23T04:21:45.363 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71840.log.gz 2023-08-23T04:21:45.363 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53317.log 2023-08-23T04:21:45.363 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36699.log.gz 2023-08-23T04:21:45.363 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64270.log 2023-08-23T04:21:45.364 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63815.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.63815.log.gz 2023-08-23T04:21:45.364 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.62693.log 2023-08-23T04:21:45.364 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53317.log.gz 2023-08-23T04:21:45.364 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62778.log 2023-08-23T04:21:45.365 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64270.log.gz 2023-08-23T04:21:45.365 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62220.log 2023-08-23T04:21:45.365 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62693.log.gz 2023-08-23T04:21:45.365 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68560.log 2023-08-23T04:21:45.365 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62778.log.gz 2023-08-23T04:21:45.366 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59971.log 2023-08-23T04:21:45.366 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62220.log: /var/log/ceph/ceph-client.admin.68560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67900.log 2023-08-23T04:21:45.366 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62220.log.gz 2023-08-23T04:21:45.366 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68560.log.gz 2023-08-23T04:21:45.366 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71485.log 2023-08-23T04:21:45.367 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59971.log.gz 2023-08-23T04:21:45.367 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74597.log 2023-08-23T04:21:45.367 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67900.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67900.log.gz 2023-08-23T04:21:45.367 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45554.log 2023-08-23T04:21:45.367 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71485.log.gz 2023-08-23T04:21:45.368 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60613.log 2023-08-23T04:21:45.368 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74597.log.gz 2023-08-23T04:21:45.368 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36463.log 2023-08-23T04:21:45.368 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45554.log.gz 2023-08-23T04:21:45.368 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43678.log 2023-08-23T04:21:45.369 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60613.log.gz 2023-08-23T04:21:45.369 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32506.log 2023-08-23T04:21:45.369 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36463.log.gz 2023-08-23T04:21:45.369 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44294.log 2023-08-23T04:21:45.369 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43678.log.gz 2023-08-23T04:21:45.370 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63471.log 2023-08-23T04:21:45.370 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32506.log.gz 2023-08-23T04:21:45.370 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52818.log 2023-08-23T04:21:45.370 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44294.log.gz 2023-08-23T04:21:45.370 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40687.log 2023-08-23T04:21:45.371 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63471.log.gz 2023-08-23T04:21:45.371 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63643.log 2023-08-23T04:21:45.371 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52818.log.gz 2023-08-23T04:21:45.371 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79801.log 2023-08-23T04:21:45.372 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40687.log.gz 2023-08-23T04:21:45.372 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77478.log 2023-08-23T04:21:45.372 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63643.log.gz 2023-08-23T04:21:45.372 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39441.log 2023-08-23T04:21:45.372 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79801.log.gz 2023-08-23T04:21:45.373 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77478.log: /var/log/ceph/ceph-client.admin.50726.log 2023-08-23T04:21:45.373 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77478.log.gz 2023-08-23T04:21:45.373 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46289.log 2023-08-23T04:21:45.373 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39441.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39441.log.gz 2023-08-23T04:21:45.373 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43049.log 2023-08-23T04:21:45.374 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50726.log.gz 2023-08-23T04:21:45.374 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72177.log 2023-08-23T04:21:45.374 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46289.log.gz 2023-08-23T04:21:45.374 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69835.log 2023-08-23T04:21:45.374 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43049.log.gz 2023-08-23T04:21:45.374 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64172.log 2023-08-23T04:21:45.375 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72177.log.gz 2023-08-23T04:21:45.375 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48119.log 2023-08-23T04:21:45.375 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69835.log: gzip 53.1%-5 -- replaced with /var/log/ceph/ceph-client.admin.69835.log.gz--verbose 2023-08-23T04:21:45.375 INFO:teuthology.orchestra.run.smithi012.stderr:-- /var/log/ceph/ceph-client.admin.32318.log 2023-08-23T04:21:45.375 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64172.log.gz 2023-08-23T04:21:45.376 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54394.log 2023-08-23T04:21:45.376 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48119.log.gz 2023-08-23T04:21:45.376 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36356.log 2023-08-23T04:21:45.376 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32318.log.gz 2023-08-23T04:21:45.376 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69460.log 2023-08-23T04:21:45.377 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54394.log.gz 2023-08-23T04:21:45.377 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68888.log 2023-08-23T04:21:45.377 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36356.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36356.log.gz 2023-08-23T04:21:45.377 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55246.log 2023-08-23T04:21:45.377 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69460.log.gz 2023-08-23T04:21:45.378 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52194.log 2023-08-23T04:21:45.378 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68888.log.gz 2023-08-23T04:21:45.378 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55246.log: /var/log/ceph/ceph-client.admin.78766.log 2023-08-23T04:21:45.378 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55246.log.gz 2023-08-23T04:21:45.378 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.52194.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39730.log 2023-08-23T04:21:45.379 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52194.log.gz 2023-08-23T04:21:45.379 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40587.log 2023-08-23T04:21:45.379 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78766.log.gz 2023-08-23T04:21:45.379 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65557.log 2023-08-23T04:21:45.379 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39730.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39730.log.gz 2023-08-23T04:21:45.380 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42267.log 2023-08-23T04:21:45.380 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40587.log.gz 2023-08-23T04:21:45.380 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67363.log 2023-08-23T04:21:45.380 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65557.log.gz 2023-08-23T04:21:45.381 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50805.log 2023-08-23T04:21:45.381 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42267.log.gz 2023-08-23T04:21:45.381 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33787.log 2023-08-23T04:21:45.381 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67363.log.gz 2023-08-23T04:21:45.381 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57540.log 2023-08-23T04:21:45.382 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50805.log.gz 2023-08-23T04:21:45.382 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72198.log 2023-08-23T04:21:45.382 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33787.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33787.log.gz 2023-08-23T04:21:45.382 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46142.log 2023-08-23T04:21:45.382 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57540.log.gz 2023-08-23T04:21:45.383 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61337.log 2023-08-23T04:21:45.383 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72198.log.gz 2023-08-23T04:21:45.383 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69400.log 2023-08-23T04:21:45.383 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46142.log.gz 2023-08-23T04:21:45.383 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71858.log 2023-08-23T04:21:45.384 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61337.log.gz 2023-08-23T04:21:45.384 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41367.log 2023-08-23T04:21:45.384 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69400.log.gz 2023-08-23T04:21:45.384 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54661.log 2023-08-23T04:21:45.384 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71858.log.gz 2023-08-23T04:21:45.385 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29614.log 2023-08-23T04:21:45.385 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41367.log.gz 2023-08-23T04:21:45.385 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66460.log 2023-08-23T04:21:45.385 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54661.log.gz 2023-08-23T04:21:45.385 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65971.log 2023-08-23T04:21:45.386 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.29614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29614.log.gz 2023-08-23T04:21:45.386 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77657.log 2023-08-23T04:21:45.386 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66460.log.gz 2023-08-23T04:21:45.386 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44357.log 2023-08-23T04:21:45.386 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65971.log.gz 2023-08-23T04:21:45.387 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44819.log 2023-08-23T04:21:45.387 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77657.log.gz 2023-08-23T04:21:45.387 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68832.log 2023-08-23T04:21:45.387 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44357.log.gz 2023-08-23T04:21:45.387 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37927.log 2023-08-23T04:21:45.388 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44819.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44819.log.gz 2023-08-23T04:21:45.388 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66632.log 2023-08-23T04:21:45.388 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68832.log.gz 2023-08-23T04:21:45.388 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64108.log 2023-08-23T04:21:45.388 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37927.log.gz 2023-08-23T04:21:45.389 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54842.log 2023-08-23T04:21:45.389 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66632.log.gz 2023-08-23T04:21:45.389 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49673.log 2023-08-23T04:21:45.389 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64108.log.gz 2023-08-23T04:21:45.389 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48782.log 2023-08-23T04:21:45.390 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56758.log 2023-08-23T04:21:45.390 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54842.log.gz 2023-08-23T04:21:45.390 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49673.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49673.log.gz 2023-08-23T04:21:45.390 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39339.log 2023-08-23T04:21:45.391 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48782.log: 22.6% -- replaced with /var/log/ceph/ceph-client.admin.48782.log.gz 2023-08-23T04:21:45.391 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44462.log 2023-08-23T04:21:45.391 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56758.log.gz 2023-08-23T04:21:45.391 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64558.log 2023-08-23T04:21:45.391 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39339.log.gz 2023-08-23T04:21:45.392 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56930.log 2023-08-23T04:21:45.392 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44462.log.gz 2023-08-23T04:21:45.392 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63600.log 2023-08-23T04:21:45.392 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64558.log.gz 2023-08-23T04:21:45.392 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37546.log 2023-08-23T04:21:45.393 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56930.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56930.log.gz 2023-08-23T04:21:45.393 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74059.log 2023-08-23T04:21:45.393 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63600.log.gz 2023-08-23T04:21:45.393 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79368.log 2023-08-23T04:21:45.393 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37546.log.gz 2023-08-23T04:21:45.394 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41127.log 2023-08-23T04:21:45.394 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74059.log.gz 2023-08-23T04:21:45.394 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69179.log 2023-08-23T04:21:45.394 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79368.log.gz 2023-08-23T04:21:45.394 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50127.log 2023-08-23T04:21:45.395 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41127.log.gz 2023-08-23T04:21:45.395 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37754.log 2023-08-23T04:21:45.395 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69179.log.gz 2023-08-23T04:21:45.395 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57325.log 2023-08-23T04:21:45.395 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50127.log.gz 2023-08-23T04:21:45.396 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69256.log 2023-08-23T04:21:45.396 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37754.log.gz 2023-08-23T04:21:45.396 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75571.log 2023-08-23T04:21:45.396 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57325.log.gz 2023-08-23T04:21:45.397 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74296.log 2023-08-23T04:21:45.397 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69256.log.gz 2023-08-23T04:21:45.397 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63923.log 2023-08-23T04:21:45.397 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75571.log: 55.9% -- replaced with /var/log/ceph/ceph-client.admin.75571.log.gz 2023-08-23T04:21:45.397 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68770.log 2023-08-23T04:21:45.398 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74296.log.gz 2023-08-23T04:21:45.398 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42794.log 2023-08-23T04:21:45.398 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63923.log.gz 2023-08-23T04:21:45.398 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44546.log 2023-08-23T04:21:45.398 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68770.log.gz 2023-08-23T04:21:45.399 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55511.log 2023-08-23T04:21:45.399 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42794.log.gz 2023-08-23T04:21:45.399 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63153.log 2023-08-23T04:21:45.399 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44546.log.gz 2023-08-23T04:21:45.399 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55511.log: /var/log/ceph/ceph-client.admin.65893.log 2023-08-23T04:21:45.400 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55511.log.gz 2023-08-23T04:21:45.400 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50967.log 2023-08-23T04:21:45.400 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63153.log.gz 2023-08-23T04:21:45.400 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63772.log 2023-08-23T04:21:45.400 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65893.log.gz 2023-08-23T04:21:45.401 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45848.log 2023-08-23T04:21:45.401 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50967.log: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.50967.log.gz 2023-08-23T04:21:45.401 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.63772.log: -- /var/log/ceph/ceph-client.admin.66782.log 2023-08-23T04:21:45.401 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63772.log.gz 2023-08-23T04:21:45.402 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39560.log 2023-08-23T04:21:45.402 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45848.log.gz 2023-08-23T04:21:45.402 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54294.log 2023-08-23T04:21:45.402 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66782.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66782.log.gz 2023-08-23T04:21:45.403 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53102.log 2023-08-23T04:21:45.403 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39560.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39560.log.gz 2023-08-23T04:21:45.403 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38863.log 2023-08-23T04:21:45.403 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54294.log.gz 2023-08-23T04:21:45.404 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48033.log 2023-08-23T04:21:45.404 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53102.log.gz 2023-08-23T04:21:45.404 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35348.log 2023-08-23T04:21:45.404 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38863.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38863.log.gz 2023-08-23T04:21:45.405 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36742.log 2023-08-23T04:21:45.405 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48033.log.gz 2023-08-23T04:21:45.405 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73017.log 2023-08-23T04:21:45.405 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35348.log.gz 2023-08-23T04:21:45.405 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65031.log 2023-08-23T04:21:45.406 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36742.log.gz 2023-08-23T04:21:45.406 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36871.log 2023-08-23T04:21:45.406 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73017.log.gz 2023-08-23T04:21:45.406 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61746.log 2023-08-23T04:21:45.406 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65031.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.65031.log.gz--verbose 2023-08-23T04:21:45.407 INFO:teuthology.orchestra.run.smithi012.stderr:-- /var/log/ceph/ceph-client.admin.69718.log 2023-08-23T04:21:45.407 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36871.log.gz 2023-08-23T04:21:45.407 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60966.log 2023-08-23T04:21:45.407 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61746.log.gz 2023-08-23T04:21:45.408 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48226.log 2023-08-23T04:21:45.408 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69718.log: 56.7% -- replaced with /var/log/ceph/ceph-client.admin.69718.log.gz 2023-08-23T04:21:45.408 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73823.log 2023-08-23T04:21:45.408 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60966.log.gz 2023-08-23T04:21:45.409 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51589.log 2023-08-23T04:21:45.409 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48226.log.gz 2023-08-23T04:21:45.409 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.73823.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49841.log 2023-08-23T04:21:45.409 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73823.log.gz 2023-08-23T04:21:45.409 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53772.log 2023-08-23T04:21:45.410 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51589.log.gz 2023-08-23T04:21:45.410 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35133.log 2023-08-23T04:21:45.410 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49841.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59864.log 2023-08-23T04:21:45.410 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49841.log.gz 2023-08-23T04:21:45.411 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53772.log.gz 2023-08-23T04:21:45.411 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41647.log 2023-08-23T04:21:45.411 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35133.log.gz 2023-08-23T04:21:45.411 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40747.log 2023-08-23T04:21:45.412 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59864.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59864.log.gz 2023-08-23T04:21:45.412 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70469.log 2023-08-23T04:21:45.412 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41647.log.gz 2023-08-23T04:21:45.412 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65578.log 2023-08-23T04:21:45.412 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40747.log.gz 2023-08-23T04:21:45.413 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35884.log 2023-08-23T04:21:45.413 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70469.log.gz 2023-08-23T04:21:45.413 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74403.log 2023-08-23T04:21:45.413 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65578.log.gz 2023-08-23T04:21:45.414 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77456.log 2023-08-23T04:21:45.414 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35884.log.gz 2023-08-23T04:21:45.414 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75160.log 2023-08-23T04:21:45.414 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74403.log.gz 2023-08-23T04:21:45.414 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32533.log 2023-08-23T04:21:45.415 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77456.log.gz 2023-08-23T04:21:45.415 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66417.log 2023-08-23T04:21:45.415 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75160.log.gz 2023-08-23T04:21:45.415 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61810.log 2023-08-23T04:21:45.415 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32533.log.gz 2023-08-23T04:21:45.416 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51739.log 2023-08-23T04:21:45.416 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66417.log.gz 2023-08-23T04:21:45.416 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43083.log 2023-08-23T04:21:45.416 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61810.log.gz 2023-08-23T04:21:45.417 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47495.log 2023-08-23T04:21:45.417 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51739.log.gz 2023-08-23T04:21:45.417 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72306.log 2023-08-23T04:21:45.417 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43083.log.gz 2023-08-23T04:21:45.417 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60781.log 2023-08-23T04:21:45.418 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47495.log.gz 2023-08-23T04:21:45.418 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38880.log 2023-08-23T04:21:45.418 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72306.log.gz 2023-08-23T04:21:45.418 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32560.log 2023-08-23T04:21:45.418 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60781.log.gz 2023-08-23T04:21:45.419 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37301.log 2023-08-23T04:21:45.419 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38880.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38880.log.gz 2023-08-23T04:21:45.419 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75848.log 2023-08-23T04:21:45.419 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32560.log.gz 2023-08-23T04:21:45.420 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78278.log 2023-08-23T04:21:45.420 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37301.log.gz 2023-08-23T04:21:45.420 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54888.log 2023-08-23T04:21:45.420 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75848.log.gz 2023-08-23T04:21:45.420 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44137.log 2023-08-23T04:21:45.421 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78278.log.gz 2023-08-23T04:21:45.421 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70900.log 2023-08-23T04:21:45.421 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54888.log.gz 2023-08-23T04:21:45.421 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57948.log 2023-08-23T04:21:45.421 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44137.log.gz 2023-08-23T04:21:45.422 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33636.log 2023-08-23T04:21:45.422 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70900.log.gz 2023-08-23T04:21:45.422 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42675.log 2023-08-23T04:21:45.422 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57948.log.gz 2023-08-23T04:21:45.422 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37583.log 2023-08-23T04:21:45.423 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33636.log.gz 2023-08-23T04:21:45.423 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77004.log 2023-08-23T04:21:45.423 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42675.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42675.log.gz 2023-08-23T04:21:45.423 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60367.log 2023-08-23T04:21:45.423 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67019.log 2023-08-23T04:21:45.424 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.77004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37583.log.gz 2023-08-23T04:21:45.424 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77004.log.gz 2023-08-23T04:21:45.424 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53665.log 2023-08-23T04:21:45.424 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60367.log.gz 2023-08-23T04:21:45.424 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68541.log 2023-08-23T04:21:45.425 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67019.log.gz 2023-08-23T04:21:45.425 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66319.log 2023-08-23T04:21:45.425 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53665.log.gz 2023-08-23T04:21:45.425 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49447.log 2023-08-23T04:21:45.425 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68541.log.gz 2023-08-23T04:21:45.426 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38034.log 2023-08-23T04:21:45.426 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66319.log.gz 2023-08-23T04:21:45.426 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39271.log 2023-08-23T04:21:45.426 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49447.log.gz 2023-08-23T04:21:45.426 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39645.log 2023-08-23T04:21:45.427 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38034.log.gz 2023-08-23T04:21:45.427 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56779.log 2023-08-23T04:21:45.427 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39271.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39271.log.gz 2023-08-23T04:21:45.427 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42147.log 2023-08-23T04:21:45.427 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39645.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39645.log.gz 2023-08-23T04:21:45.428 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60127.log 2023-08-23T04:21:45.428 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56779.log.gz 2023-08-23T04:21:45.428 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44052.log 2023-08-23T04:21:45.428 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42147.log.gz 2023-08-23T04:21:45.428 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61681.log 2023-08-23T04:21:45.429 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60127.log.gz 2023-08-23T04:21:45.429 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49425.log 2023-08-23T04:21:45.429 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44052.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44052.log.gz 2023-08-23T04:21:45.429 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47414.log 2023-08-23T04:21:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61681.log.gz 2023-08-23T04:21:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50169.log 2023-08-23T04:21:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49425.log.gz 2023-08-23T04:21:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34573.log 2023-08-23T04:21:45.430 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47414.log.gz 2023-08-23T04:21:45.431 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35770.log 2023-08-23T04:21:45.431 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50169.log.gz 2023-08-23T04:21:45.431 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71445.log 2023-08-23T04:21:45.431 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34573.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34573.log.gz 2023-08-23T04:21:45.431 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67857.log 2023-08-23T04:21:45.432 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35770.log.gz 2023-08-23T04:21:45.432 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62392.log 2023-08-23T04:21:45.432 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71445.log.gz 2023-08-23T04:21:45.432 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38120.log 2023-08-23T04:21:45.432 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67857.log.gz 2023-08-23T04:21:45.433 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52903.log 2023-08-23T04:21:45.433 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62392.log.gz 2023-08-23T04:21:45.433 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34687.log 2023-08-23T04:21:45.433 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38120.log.gz 2023-08-23T04:21:45.433 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.52903.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.38615.log 2023-08-23T04:21:45.434 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52903.log.gz 2023-08-23T04:21:45.434 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49241.log 2023-08-23T04:21:45.434 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34687.log.gz 2023-08-23T04:21:45.434 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73565.log 2023-08-23T04:21:45.435 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38615.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38615.log.gz 2023-08-23T04:21:45.435 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57368.log 2023-08-23T04:21:45.435 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49241.log.gz 2023-08-23T04:21:45.435 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50029.log 2023-08-23T04:21:45.435 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73565.log.gz 2023-08-23T04:21:45.436 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41447.log 2023-08-23T04:21:45.436 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57368.log: 26.8% -- replaced with /var/log/ceph/ceph-client.admin.57368.log.gz 2023-08-23T04:21:45.436 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34195.log 2023-08-23T04:21:45.436 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50029.log.gz 2023-08-23T04:21:45.436 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69082.log 2023-08-23T04:21:45.437 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41447.log.gz 2023-08-23T04:21:45.437 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60655.log 2023-08-23T04:21:45.437 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34195.log.gz 2023-08-23T04:21:45.437 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79036.log 2023-08-23T04:21:45.438 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69082.log.gz 2023-08-23T04:21:45.438 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73608.log 2023-08-23T04:21:45.438 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60655.log.gz 2023-08-23T04:21:45.438 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73952.log 2023-08-23T04:21:45.438 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79036.log.gz 2023-08-23T04:21:45.439 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52839.log 2023-08-23T04:21:45.439 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73608.log.gz 2023-08-23T04:21:45.439 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40189.log 2023-08-23T04:21:45.439 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73952.log.gz 2023-08-23T04:21:45.439 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69759.log 2023-08-23T04:21:45.440 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74339.log 2023-08-23T04:21:45.440 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52839.log.gz 2023-08-23T04:21:45.440 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40189.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40189.log.gz 2023-08-23T04:21:45.440 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.69759.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.73224.log 2023-08-23T04:21:45.441 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69759.log.gz 2023-08-23T04:21:45.441 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71095.log 2023-08-23T04:21:45.441 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74339.log.gz 2023-08-23T04:21:45.441 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53259.log 2023-08-23T04:21:45.441 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73224.log.gz 2023-08-23T04:21:45.442 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.71095.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.79310.log 2023-08-23T04:21:45.442 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71095.log.gz 2023-08-23T04:21:45.442 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71780.log 2023-08-23T04:21:45.442 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53259.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.53259.log.gz 2023-08-23T04:21:45.442 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46977.log 2023-08-23T04:21:45.443 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79310.log.gz 2023-08-23T04:21:45.443 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61359.log 2023-08-23T04:21:45.443 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71780.log: 56.3% -- replaced with /var/log/ceph/ceph-client.admin.71780.log.gz 2023-08-23T04:21:45.443 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37817.log 2023-08-23T04:21:45.443 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46977.log.gz 2023-08-23T04:21:45.443 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64450.log 2023-08-23T04:21:45.444 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61359.log.gz 2023-08-23T04:21:45.444 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56220.log 2023-08-23T04:21:45.444 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37817.log.gz 2023-08-23T04:21:45.444 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53437.log 2023-08-23T04:21:45.445 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64450.log.gz 2023-08-23T04:21:45.445 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41827.log 2023-08-23T04:21:45.445 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56220.log.gz 2023-08-23T04:21:45.445 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35305.log 2023-08-23T04:21:45.445 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53437.log.gz 2023-08-23T04:21:45.445 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68597.log 2023-08-23T04:21:45.446 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41827.log.gz 2023-08-23T04:21:45.446 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53837.log 2023-08-23T04:21:45.446 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35305.log.gz 2023-08-23T04:21:45.446 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74683.log 2023-08-23T04:21:45.446 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68597.log.gz 2023-08-23T04:21:45.447 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47182.log /var/log/ceph/ceph-client.admin.53837.log: 2023-08-23T04:21:45.447 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53837.log.gz 2023-08-23T04:21:45.447 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64290.log 2023-08-23T04:21:45.447 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74683.log.gz 2023-08-23T04:21:45.447 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74747.log 2023-08-23T04:21:45.448 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47182.log.gz 2023-08-23T04:21:45.448 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47126.log 2023-08-23T04:21:45.448 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64290.log.gz 2023-08-23T04:21:45.448 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40727.log 2023-08-23T04:21:45.449 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74747.log.gz 2023-08-23T04:21:45.449 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47126.log: /var/log/ceph/ceph-client.admin.66176.log 2023-08-23T04:21:45.449 INFO:teuthology.orchestra.run.smithi012.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.47126.log.gz 2023-08-23T04:21:45.449 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70839.log 2023-08-23T04:21:45.449 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40727.log.gz 2023-08-23T04:21:45.450 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74833.log 2023-08-23T04:21:45.450 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66176.log.gz 2023-08-23T04:21:45.450 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51911.log 2023-08-23T04:21:45.450 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70839.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70839.log.gz 2023-08-23T04:21:45.450 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42743.log 2023-08-23T04:21:45.451 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74833.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74833.log.gz 2023-08-23T04:21:45.451 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50705.log 2023-08-23T04:21:45.451 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51911.log.gz 2023-08-23T04:21:45.451 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.42743.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46848.log 2023-08-23T04:21:45.451 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42743.log.gz 2023-08-23T04:21:45.451 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43984.log 2023-08-23T04:21:45.452 INFO:teuthology.orchestra.run.smithi012.stderr: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.50705.log.gz 2023-08-23T04:21:45.452 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42573.log 2023-08-23T04:21:45.452 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71405.log 2023-08-23T04:21:45.452 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46848.log.gz 2023-08-23T04:21:45.453 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43984.log.gz 2023-08-23T04:21:45.453 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.42573.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60716.log 2023-08-23T04:21:45.453 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42573.log.gz 2023-08-23T04:21:45.453 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50867.log 2023-08-23T04:21:45.453 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71405.log.gz 2023-08-23T04:21:45.454 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41607.log 2023-08-23T04:21:45.454 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60716.log.gz 2023-08-23T04:21:45.454 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76128.log 2023-08-23T04:21:45.454 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50867.log.gz 2023-08-23T04:21:45.454 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38594.log 2023-08-23T04:21:45.454 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41607.log.gz 2023-08-23T04:21:45.455 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62198.log 2023-08-23T04:21:45.455 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76128.log.gz 2023-08-23T04:21:45.455 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74931.log 2023-08-23T04:21:45.455 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38594.log.gz 2023-08-23T04:21:45.455 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47353.log 2023-08-23T04:21:45.456 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62198.log.gz 2023-08-23T04:21:45.456 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57647.log 2023-08-23T04:21:45.456 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74931.log.gz 2023-08-23T04:21:45.456 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60147.log 2023-08-23T04:21:45.456 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47353.log.gz 2023-08-23T04:21:45.457 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54116.log 2023-08-23T04:21:45.457 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57647.log.gz 2023-08-23T04:21:45.457 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59477.log 2023-08-23T04:21:45.457 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60147.log: 27.1% -- replaced with /var/log/ceph/ceph-client.admin.60147.log.gz 2023-08-23T04:21:45.457 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54116.log.gz 2023-08-23T04:21:45.458 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52753.log 2023-08-23T04:21:45.458 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69340.log 2023-08-23T04:21:45.458 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59477.log.gz 2023-08-23T04:21:45.458 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75078.log 2023-08-23T04:21:45.458 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52753.log.gz 2023-08-23T04:21:45.459 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60288.log 2023-08-23T04:21:45.459 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69340.log.gz 2023-08-23T04:21:45.459 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46805.log 2023-08-23T04:21:45.459 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75078.log.gz 2023-08-23T04:21:45.459 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60288.log: /var/log/ceph/ceph-client.admin.37775.log 2023-08-23T04:21:45.460 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60288.log.gz 2023-08-23T04:21:45.460 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54640.log 2023-08-23T04:21:45.460 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46805.log.gz 2023-08-23T04:21:45.460 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69123.log 2023-08-23T04:21:45.461 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37775.log.gz 2023-08-23T04:21:45.461 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32748.log 2023-08-23T04:21:45.461 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54640.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.54640.log.gz-5 2023-08-23T04:21:45.461 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.70049.log 2023-08-23T04:21:45.461 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69123.log.gz 2023-08-23T04:21:45.462 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74532.log 2023-08-23T04:21:45.462 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32748.log.gz 2023-08-23T04:21:45.462 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50565.log 2023-08-23T04:21:45.462 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70049.log.gz 2023-08-23T04:21:45.463 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32425.log 2023-08-23T04:21:45.463 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74532.log.gz 2023-08-23T04:21:45.463 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34517.log 2023-08-23T04:21:45.463 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50565.log.gz 2023-08-23T04:21:45.463 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36678.log 2023-08-23T04:21:45.464 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32425.log.gz 2023-08-23T04:21:45.464 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66804.log 2023-08-23T04:21:45.464 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34517.log.gz 2023-08-23T04:21:45.464 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50647.log 2023-08-23T04:21:45.465 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36678.log.gz 2023-08-23T04:21:45.465 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53557.log 2023-08-23T04:21:45.465 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66804.log.gz 2023-08-23T04:21:45.465 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73651.log 2023-08-23T04:21:45.465 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50647.log.gz 2023-08-23T04:21:45.466 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39934.log 2023-08-23T04:21:45.466 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53557.log.gz 2023-08-23T04:21:45.466 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78305.log 2023-08-23T04:21:45.466 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73651.log.gz 2023-08-23T04:21:45.466 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61252.log 2023-08-23T04:21:45.467 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39934.log: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39934.log.gz 2023-08-23T04:21:45.467 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33942.log 2023-08-23T04:21:45.467 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78305.log.gz 2023-08-23T04:21:45.467 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33978.log 2023-08-23T04:21:45.467 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61252.log: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.61252.log.gz 2023-08-23T04:21:45.468 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76789.log 2023-08-23T04:21:45.468 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33942.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33942.log.gz 2023-08-23T04:21:45.468 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73672.log 2023-08-23T04:21:45.468 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33978.log.gz 2023-08-23T04:21:45.469 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38948.log 2023-08-23T04:21:45.469 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76789.log.gz 2023-08-23T04:21:45.469 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47199.log 2023-08-23T04:21:45.469 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73672.log.gz 2023-08-23T04:21:45.469 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56133.log 2023-08-23T04:21:45.470 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38948.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38948.log.gz 2023-08-23T04:21:45.470 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67535.log 2023-08-23T04:21:45.470 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47199.log: 22.9% -- replaced with /var/log/ceph/ceph-client.admin.47199.log.gz 2023-08-23T04:21:45.470 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50330.log 2023-08-23T04:21:45.471 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56133.log.gz 2023-08-23T04:21:45.471 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67449.log 2023-08-23T04:21:45.471 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67535.log.gz 2023-08-23T04:21:45.472 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61050.log 2023-08-23T04:21:45.472 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50330.log.gz 2023-08-23T04:21:45.472 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52474.log 2023-08-23T04:21:45.473 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67449.log.gz 2023-08-23T04:21:45.473 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59606.log 2023-08-23T04:21:45.473 INFO:teuthology.orchestra.run.smithi012.stderr: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.61050.log.gz 2023-08-23T04:21:45.474 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55406.log 2023-08-23T04:21:45.474 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52474.log.gz 2023-08-23T04:21:45.474 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47732.log 2023-08-23T04:21:45.475 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59606.log.gz 2023-08-23T04:21:45.475 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77476.log 2023-08-23T04:21:45.475 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55406.log.gz 2023-08-23T04:21:45.476 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70089.log 2023-08-23T04:21:45.476 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47732.log.gz 2023-08-23T04:21:45.476 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.77476.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.69239.log 2023-08-23T04:21:45.477 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77476.log.gz 2023-08-23T04:21:45.477 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34940.log 2023-08-23T04:21:45.477 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70089.log.gz 2023-08-23T04:21:45.478 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34499.log 2023-08-23T04:21:45.478 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69239.log.gz 2023-08-23T04:21:45.479 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.34940.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70029.log 2023-08-23T04:21:45.479 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34940.log.gz 2023-08-23T04:21:45.479 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62795.log 2023-08-23T04:21:45.480 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34499.log.gz 2023-08-23T04:21:45.480 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71546.log 2023-08-23T04:21:45.480 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70029.log.gz 2023-08-23T04:21:45.481 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76149.log 2023-08-23T04:21:45.481 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62795.log.gz 2023-08-23T04:21:45.481 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39866.log 2023-08-23T04:21:45.482 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71546.log.gz 2023-08-23T04:21:45.482 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78603.log 2023-08-23T04:21:45.483 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76149.log.gz 2023-08-23T04:21:45.483 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70739.log 2023-08-23T04:21:45.483 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39866.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39866.log.gz 2023-08-23T04:21:45.484 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-23T04:21:45.484 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78603.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.41487.log 2023-08-23T04:21:45.484 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78603.log.gz 2023-08-23T04:21:45.485 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70739.log: gzip /var/log/ceph/ceph.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.53359.log 2023-08-23T04:21:45.485 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70739.log.gz 2023-08-23T04:21:45.485 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34918.log 2023-08-23T04:21:45.486 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41487.log.gz 2023-08-23T04:21:45.486 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46375.log 2023-08-23T04:21:45.487 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53359.log.gz 2023-08-23T04:21:45.487 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34918.log.gz 2023-08-23T04:21:45.487 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71365.log 2023-08-23T04:21:45.488 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.46375.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.57991.log 2023-08-23T04:21:45.488 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46375.log.gz 2023-08-23T04:21:45.489 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43134.log 2023-08-23T04:21:45.489 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71365.log.gz 2023-08-23T04:21:45.489 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75484.log 2023-08-23T04:21:45.490 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57991.log.gz 2023-08-23T04:21:45.490 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48879.log 2023-08-23T04:21:45.490 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43134.log.gz 2023-08-23T04:21:45.491 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68982.log 2023-08-23T04:21:45.491 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75484.log.gz 2023-08-23T04:21:45.491 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78684.log 2023-08-23T04:21:45.492 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48879.log: 23.1% -- replaced with /var/log/ceph/ceph-client.admin.48879.log.gz 2023-08-23T04:21:45.492 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72542.log 2023-08-23T04:21:45.493 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68982.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68982.log.gz 2023-08-23T04:21:45.493 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69740.log 2023-08-23T04:21:45.493 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78684.log.gz 2023-08-23T04:21:45.494 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63364.log 2023-08-23T04:21:45.494 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72542.log.gz 2023-08-23T04:21:45.494 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57137.log 2023-08-23T04:21:45.495 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52517.log 2023-08-23T04:21:45.495 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69740.log.gz 2023-08-23T04:21:45.496 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63364.log.gz 2023-08-23T04:21:45.496 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57137.log.gz 2023-08-23T04:21:45.496 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64945.log 2023-08-23T04:21:45.497 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53987.log 2023-08-23T04:21:45.497 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52517.log.gz 2023-08-23T04:21:45.497 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60428.log 2023-08-23T04:21:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64945.log.gz 2023-08-23T04:21:45.498 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53987.log.gz 2023-08-23T04:21:45.499 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60036.log 2023-08-23T04:21:45.499 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60428.log: /var/log/ceph/ceph-client.admin.61423.log 2023-08-23T04:21:45.499 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60428.log.gz 2023-08-23T04:21:45.500 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.60036.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.65499.log 2023-08-23T04:21:45.500 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60036.log.gz 2023-08-23T04:21:45.501 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46568.log 2023-08-23T04:21:45.501 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66503.log 2023-08-23T04:21:45.502 INFO:teuthology.orchestra.run.smithi012.stderr: 23.2% -- replaced with /var/log/ceph/ceph-client.admin.61423.log.gz 2023-08-23T04:21:45.502 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65499.log.gz 2023-08-23T04:21:45.502 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48517.log 2023-08-23T04:21:45.503 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46568.log.gz 2023-08-23T04:21:45.503 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63837.log 2023-08-23T04:21:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66503.log: /var/log/ceph/ceph-client.admin.48517.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.66503.log.gz 2023-08-23T04:21:45.504 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71345.log 2023-08-23T04:21:45.504 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48517.log.gz 2023-08-23T04:21:45.505 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66256.log 2023-08-23T04:21:45.505 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63837.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54684.log 2023-08-23T04:21:45.505 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71345.log: -- replaced with /var/log/ceph/ceph-client.admin.63837.log.gz 2023-08-23T04:21:45.505 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71345.log.gz 2023-08-23T04:21:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49758.log 2023-08-23T04:21:45.506 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66256.log.gz 2023-08-23T04:21:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64429.log 2023-08-23T04:21:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54684.log.gz 2023-08-23T04:21:45.506 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73159.log 2023-08-23T04:21:45.507 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49758.log: 57.1% -- replaced with /var/log/ceph/ceph-client.admin.49758.log.gz 2023-08-23T04:21:45.507 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.64429.log: -- /var/log/ceph/ceph-client.admin.64030.log 2023-08-23T04:21:45.507 INFO:teuthology.orchestra.run.smithi012.stderr: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.64429.log.gz 2023-08-23T04:21:45.507 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75201.log 2023-08-23T04:21:45.508 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47455.log 2023-08-23T04:21:45.508 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73159.log.gz/var/log/ceph/ceph-client.admin.64030.log: 2023-08-23T04:21:45.508 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64967.log 2023-08-23T04:21:45.508 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75201.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64030.log.gz 2023-08-23T04:21:45.509 INFO:teuthology.orchestra.run.smithi012.stderr: 22.8% -- replaced with /var/log/ceph/ceph-client.admin.75201.log.gz 2023-08-23T04:21:45.509 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47455.log.gz 2023-08-23T04:21:45.509 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64051.log 2023-08-23T04:21:45.510 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50210.log 2023-08-23T04:21:45.510 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64967.log.gz 2023-08-23T04:21:45.510 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50190.log 2023-08-23T04:21:45.511 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64051.log.gz 2023-08-23T04:21:45.511 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.50210.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.61168.log 2023-08-23T04:21:45.511 INFO:teuthology.orchestra.run.smithi012.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.50210.log.gz 2023-08-23T04:21:45.512 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56306.log 2023-08-23T04:21:45.512 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50190.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72026.log 2023-08-23T04:21:45.512 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50190.log.gz 2023-08-23T04:21:45.512 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48559.log 2023-08-23T04:21:45.513 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56306.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61168.log.gz 2023-08-23T04:21:45.513 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56306.log.gz 2023-08-23T04:21:45.513 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70293.log 2023-08-23T04:21:45.513 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72026.log.gz 2023-08-23T04:21:45.514 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-08-23T04:21:45.514 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48559.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48559.log.gz 2023-08-23T04:21:45.514 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57411.log 2023-08-23T04:21:45.514 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70293.log.gz 2023-08-23T04:21:45.514 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-osd.0.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.69892.log 2023-08-23T04:21:45.515 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41527.log 2023-08-23T04:21:45.515 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57411.log.gz/var/log/ceph/ceph-client.admin.69892.log: 2023-08-23T04:21:45.515 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72607.log 2023-08-23T04:21:45.515 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69892.log.gz 2023-08-23T04:21:45.516 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36270.log 2023-08-23T04:21:45.516 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41527.log.gz 2023-08-23T04:21:45.516 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72607.log.gz 2023-08-23T04:21:45.516 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67728.log 2023-08-23T04:21:45.517 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38357.log 2023-08-23T04:21:45.517 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36270.log.gz 2023-08-23T04:21:45.517 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67728.log.gz 2023-08-23T04:21:45.517 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79009.log 2023-08-23T04:21:45.518 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38357.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38357.log.gz 2023-08-23T04:21:45.518 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48702.log 2023-08-23T04:21:45.518 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57178.log 2023-08-23T04:21:45.518 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79009.log.gz 2023-08-23T04:21:45.518 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54516.log 2023-08-23T04:21:45.518 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48702.log.gz 2023-08-23T04:21:45.519 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78062.log 2023-08-23T04:21:45.519 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57178.log.gz 2023-08-23T04:21:45.519 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39968.log 2023-08-23T04:21:45.519 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54516.log.gz 2023-08-23T04:21:45.519 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72692.log 2023-08-23T04:21:45.520 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78062.log.gz 2023-08-23T04:21:45.520 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39968.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39968.log.gz 2023-08-23T04:21:45.520 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56908.log 2023-08-23T04:21:45.520 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51696.log 2023-08-23T04:21:45.521 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48054.log 2023-08-23T04:21:45.521 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72692.log.gz 2023-08-23T04:21:45.521 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56908.log.gz/var/log/ceph/ceph-client.admin.51696.log: 2023-08-23T04:21:45.521 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51696.log.gz 2023-08-23T04:21:45.521 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74661.log 2023-08-23T04:21:45.522 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78143.log 2023-08-23T04:21:45.522 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48054.log: /var/log/ceph/ceph-client.admin.74661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48054.log.gz 2023-08-23T04:21:45.522 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74661.log.gz 2023-08-23T04:21:45.522 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65399.log 2023-08-23T04:21:45.522 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43882.log 2023-08-23T04:21:45.523 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78143.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78143.log.gz 2023-08-23T04:21:45.523 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65399.log: /var/log/ceph/ceph-client.admin.49101.log 2023-08-23T04:21:45.523 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65399.log.gz 2023-08-23T04:21:45.523 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43185.log 2023-08-23T04:21:45.524 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43882.log.gz 2023-08-23T04:21:45.524 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49101.log.gz 2023-08-23T04:21:45.524 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49861.log 2023-08-23T04:21:45.525 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43185.log.gz 2023-08-23T04:21:45.525 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33070.log 2023-08-23T04:21:45.526 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49820.log 2023-08-23T04:21:45.526 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49861.log.gz 2023-08-23T04:21:45.526 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43763.log 2023-08-23T04:21:45.527 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33070.log.gz 2023-08-23T04:21:45.527 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49820.log.gz 2023-08-23T04:21:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39662.log 2023-08-23T04:21:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51438.log 2023-08-23T04:21:45.528 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43763.log.gz 2023-08-23T04:21:45.529 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34854.log 2023-08-23T04:21:45.529 INFO:teuthology.orchestra.run.smithi012.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39662.log.gz 2023-08-23T04:21:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79063.log 2023-08-23T04:21:45.530 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51438.log: /var/log/ceph/ceph-client.admin.34854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40627.log 2023-08-23T04:21:45.530 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51438.log.gz 2023-08-23T04:21:45.531 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34854.log.gz 2023-08-23T04:21:45.531 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39985.log 2023-08-23T04:21:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79063.log.gz 2023-08-23T04:21:45.532 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45386.log 2023-08-23T04:21:45.532 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40627.log.gz 2023-08-23T04:21:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39985.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39985.log.gz 2023-08-23T04:21:45.533 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48741.log 2023-08-23T04:21:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45386.log.gz 2023-08-23T04:21:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63944.log 2023-08-23T04:21:45.534 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49881.log 2023-08-23T04:21:45.535 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48741.log.gz 2023-08-23T04:21:45.535 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43729.log 2023-08-23T04:21:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63944.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63944.log.gz 2023-08-23T04:21:45.536 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57475.log 2023-08-23T04:21:45.537 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49881.log.gz 2023-08-23T04:21:45.537 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71983.log 2023-08-23T04:21:45.537 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43729.log.gz 2023-08-23T04:21:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57475.log.gz 2023-08-23T04:21:45.538 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34114.log 2023-08-23T04:21:45.539 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71983.log.gz 2023-08-23T04:21:45.539 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64009.log 2023-08-23T04:21:45.540 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49571.log 2023-08-23T04:21:45.540 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34114.log.gz 2023-08-23T04:21:45.540 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59520.log 2023-08-23T04:21:45.541 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64009.log.gz 2023-08-23T04:21:45.541 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41747.log 2023-08-23T04:21:45.541 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49571.log.gz 2023-08-23T04:21:45.542 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59520.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69061.log 2023-08-23T04:21:45.542 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59520.log.gz 2023-08-23T04:21:45.543 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41747.log.gz 2023-08-23T04:21:45.543 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46058.log 2023-08-23T04:21:45.543 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69061.log.gz 2023-08-23T04:21:45.544 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56865.log 2023-08-23T04:21:45.544 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34751.log 2023-08-23T04:21:45.544 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46058.log.gz/var/log/ceph/ceph-client.admin.56865.log: 2023-08-23T04:21:45.544 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50684.log 2023-08-23T04:21:45.544 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56865.log.gz 2023-08-23T04:21:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34897.log 2023-08-23T04:21:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34751.log: /var/log/ceph/ceph-client.admin.50684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50684.log.gz 2023-08-23T04:21:45.545 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34751.log.gz 2023-08-23T04:21:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57454.log 2023-08-23T04:21:45.545 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41347.log 2023-08-23T04:21:45.546 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34897.log.gz 2023-08-23T04:21:45.546 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79746.log 2023-08-23T04:21:45.546 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57454.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50548.log 2023-08-23T04:21:45.546 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57454.log.gz 2023-08-23T04:21:45.547 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41347.log: /var/log/ceph/ceph-client.admin.79746.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41347.log.gz 0.0% 2023-08-23T04:21:45.547 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.79746.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63173.log 2023-08-23T04:21:45.547 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:21:45.548 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43644.log 2023-08-23T04:21:45.548 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50548.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.50548.log.gz 2023-08-23T04:21:45.548 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63173.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63173.log.gz 2023-08-23T04:21:45.549 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52667.log 2023-08-23T04:21:45.549 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57776.log 2023-08-23T04:21:45.549 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51267.log 2023-08-23T04:21:45.549 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43644.log.gz/var/log/ceph/ceph-client.admin.52667.log: 2023-08-23T04:21:45.549 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0%/var/log/ceph/ceph-client.admin.57776.log: -- replaced with /var/log/ceph/ceph-client.admin.52667.log.gz 0.0% 2023-08-23T04:21:45.550 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57776.log.gz 2023-08-23T04:21:45.550 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74575.log 2023-08-23T04:21:45.550 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38550.log 2023-08-23T04:21:45.550 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42127.log 2023-08-23T04:21:45.550 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74575.log: 0.0% 92.3%gzip -- replaced with /var/log/ceph/ceph.log.gz-5 2023-08-23T04:21:45.551 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.67126.log 2023-08-23T04:21:45.551 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74575.log.gz 2023-08-23T04:21:45.551 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37645.log 2023-08-23T04:21:45.551 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42127.log: 22.4% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38550.log.gz 2023-08-23T04:21:45.551 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42127.log.gz 2023-08-23T04:21:45.552 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0%/var/log/ceph/ceph-client.admin.67126.log: -- replaced with /var/log/ceph/ceph-client.admin.51267.log.gz 2023-08-23T04:21:45.552 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67126.log.gz 2023-08-23T04:21:45.552 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49181.log 2023-08-23T04:21:45.552 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37645.log.gz 2023-08-23T04:21:45.552 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60449.log 2023-08-23T04:21:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48011.log 2023-08-23T04:21:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49181.log: /var/log/ceph/ceph-client.admin.60449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59563.log 2023-08-23T04:21:45.553 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60449.log.gz 2023-08-23T04:21:45.553 INFO:teuthology.orchestra.run.smithi012.stderr: 15.7% -- replaced with /var/log/ceph/ceph-client.admin.49181.log.gz 2023-08-23T04:21:45.553 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48011.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48011.log.gz 2023-08-23T04:21:45.554 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47882.log 2023-08-23T04:21:45.554 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59563.log.gz 2023-08-23T04:21:45.554 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63536.log 2023-08-23T04:21:45.554 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72327.log 2023-08-23T04:21:45.554 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47882.log: /var/log/ceph/ceph-client.admin.63536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65930.log 0.0% 2023-08-23T04:21:45.555 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47882.log.gz 2023-08-23T04:21:45.555 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63536.log.gz 2023-08-23T04:21:45.555 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47220.log 2023-08-23T04:21:45.555 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72327.log.gz 2023-08-23T04:21:45.556 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33099.log 2023-08-23T04:21:45.556 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65930.log.gz 2023-08-23T04:21:45.556 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47220.log.gz 2023-08-23T04:21:45.556 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68247.log 2023-08-23T04:21:45.557 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52302.log 2023-08-23T04:21:45.557 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33099.log.gz 2023-08-23T04:21:45.557 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53338.log 2023-08-23T04:21:45.558 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68247.log.gz 2023-08-23T04:21:45.558 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33744.log 2023-08-23T04:21:45.558 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52302.log.gz 2023-08-23T04:21:45.558 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65520.log 2023-08-23T04:21:45.559 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53338.log.gz 2023-08-23T04:21:45.559 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54619.log 2023-08-23T04:21:45.559 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33744.log.gz 2023-08-23T04:21:45.559 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68908.log 2023-08-23T04:21:45.560 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65520.log.gz 2023-08-23T04:21:45.560 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50888.log 2023-08-23T04:21:45.561 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54619.log.gz 2023-08-23T04:21:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73844.log 2023-08-23T04:21:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68908.log.gz 2023-08-23T04:21:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29700.log 2023-08-23T04:21:45.561 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50888.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.50888.log.gz 2023-08-23T04:21:45.562 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72916.log 2023-08-23T04:21:45.562 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73844.log.gz 2023-08-23T04:21:45.562 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66524.log 2023-08-23T04:21:45.562 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.29700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.29700.log.gz 2023-08-23T04:21:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36764.log 2023-08-23T04:21:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72916.log.gz 2023-08-23T04:21:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2023-08-23T04:21:45.563 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66524.log.gz 2023-08-23T04:21:45.563 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37872.log 2023-08-23T04:21:45.564 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36764.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36764.log.gz 2023-08-23T04:21:45.564 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54477.log 2023-08-23T04:21:45.564 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2023-08-23T04:21:45.564 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45407.log 2023-08-23T04:21:45.565 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37872.log.gz 2023-08-23T04:21:45.565 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68810.log 2023-08-23T04:21:45.565 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54477.log.gz 2023-08-23T04:21:45.565 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38812.log 2023-08-23T04:21:45.565 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45407.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66299.log 2023-08-23T04:21:45.566 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:21:45.566 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68810.log: 53.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67836.log 2023-08-23T04:21:45.566 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38812.log: -- replaced with /var/log/ceph/ceph-client.admin.68810.log.gz 2023-08-23T04:21:45.566 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38812.log.gz 2023-08-23T04:21:45.567 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67255.log 2023-08-23T04:21:45.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66299.log.gz 2023-08-23T04:21:45.567 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62585.log 2023-08-23T04:21:45.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46826.log 2023-08-23T04:21:45.567 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67836.log.gz 2023-08-23T04:21:45.568 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67255.log.gz 2023-08-23T04:21:45.568 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68458.log 2023-08-23T04:21:45.568 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62585.log.gz 2023-08-23T04:21:45.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64623.log 2023-08-23T04:21:45.569 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46826.log.gz 2023-08-23T04:21:45.569 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61617.log 2023-08-23T04:21:45.570 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68458.log.gz 2023-08-23T04:21:45.570 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73328.log 2023-08-23T04:21:45.570 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64623.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51025.log 2023-08-23T04:21:45.571 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:21:45.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61617.log.gz 2023-08-23T04:21:45.571 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49061.log 2023-08-23T04:21:45.571 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73328.log: 24.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2023-08-23T04:21:45.571 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73328.log.gz 2023-08-23T04:21:45.572 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51025.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51025.log.gz-5 2023-08-23T04:21:45.572 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.49198.log 2023-08-23T04:21:45.572 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49061.log: 56.9% -- replaced with /var/log/ceph/ceph-client.admin.49061.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54224.log 2023-08-23T04:21:45.572 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:21:45.572 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75676.log 2023-08-23T04:21:45.573 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2023-08-23T04:21:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49198.log: 53.6% -- replaced with /var/log/ceph/ceph-client.admin.49198.log.gz 2023-08-23T04:21:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54224.log.gz 2023-08-23T04:21:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35026.log 2023-08-23T04:21:45.573 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78197.log 2023-08-23T04:21:45.574 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75676.log.gz 2023-08-23T04:21:45.574 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35882.log 2023-08-23T04:21:45.574 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35026.log.gz 2023-08-23T04:21:45.574 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39526.log 2023-08-23T04:21:45.574 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78197.log.gz 2023-08-23T04:21:45.575 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.35882.log: -- /var/log/ceph/ceph-client.admin.36420.log 2023-08-23T04:21:45.575 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35882.log.gz 2023-08-23T04:21:45.575 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43865.log 2023-08-23T04:21:45.575 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39526.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39526.log.gz 2023-08-23T04:21:45.576 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51374.log 2023-08-23T04:21:45.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36420.log.gz 2023-08-23T04:21:45.576 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55683.log 2023-08-23T04:21:45.576 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43865.log.gz 2023-08-23T04:21:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68728.log 2023-08-23T04:21:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51374.log.gz 2023-08-23T04:21:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70334.log 2023-08-23T04:21:45.577 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55683.log.gz 2023-08-23T04:21:45.578 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.68728.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.37511.log 2023-08-23T04:21:45.578 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68728.log.gz 2023-08-23T04:21:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.70334.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.77155.log 2023-08-23T04:21:45.579 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70334.log.gz 2023-08-23T04:21:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47517.log 2023-08-23T04:21:45.579 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37511.log.gz 2023-08-23T04:21:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.77155.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.56607.log 2023-08-23T04:21:45.580 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.77155.log.gz 2023-08-23T04:21:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47517.log.gz 2023-08-23T04:21:45.580 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38077.log 2023-08-23T04:21:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45197.log 2023-08-23T04:21:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56607.log.gz 2023-08-23T04:21:45.581 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32880.log 2023-08-23T04:21:45.582 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38077.log.gz 2023-08-23T04:21:45.582 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56263.log 2023-08-23T04:21:45.582 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45197.log.gz 2023-08-23T04:21:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33679.log 2023-08-23T04:21:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32880.log.gz 2023-08-23T04:21:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38421.log 2023-08-23T04:21:45.583 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56263.log.gz 2023-08-23T04:21:45.583 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66696.log 2023-08-23T04:21:45.584 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33679.log.gz 2023-08-23T04:21:45.584 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79449.log 2023-08-23T04:21:45.584 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38421.log.gz 2023-08-23T04:21:45.584 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35241.log 2023-08-23T04:21:45.584 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66696.log.gz 2023-08-23T04:21:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34479.log 2023-08-23T04:21:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79449.log.gz 2023-08-23T04:21:45.585 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71821.log 2023-08-23T04:21:45.585 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35241.log.gz 2023-08-23T04:21:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71035.log 2023-08-23T04:21:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34479.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.34479.log.gz 2023-08-23T04:21:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47710.log 2023-08-23T04:21:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71821.log.gz 2023-08-23T04:21:45.586 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.71035.log: --verbose -- /var/log/ceph/ceph-client.admin.35477.log 2023-08-23T04:21:45.587 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71035.log.gz 2023-08-23T04:21:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44120.log 2023-08-23T04:21:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47710.log.gz 2023-08-23T04:21:45.587 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.35477.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54354.log 2023-08-23T04:21:45.587 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35477.log.gz 2023-08-23T04:21:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75805.log 2023-08-23T04:21:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44120.log.gz 2023-08-23T04:21:45.588 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40507.log 2023-08-23T04:21:45.588 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54354.log.gz 2023-08-23T04:21:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40087.log 2023-08-23T04:21:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75805.log.gz 2023-08-23T04:21:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37528.log 2023-08-23T04:21:45.589 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40507.log.gz 2023-08-23T04:21:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71211.log 2023-08-23T04:21:45.590 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40087.log.gz 2023-08-23T04:21:45.590 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55304.log 2023-08-23T04:21:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37528.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37528.log.gz 2023-08-23T04:21:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38573.log 2023-08-23T04:21:45.591 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71211.log.gz 2023-08-23T04:21:45.592 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61210.log 2023-08-23T04:21:45.592 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55304.log.gz 2023-08-23T04:21:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.38573.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.66997.log 2023-08-23T04:21:45.593 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38573.log.gz 2023-08-23T04:21:45.593 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38228.log 2023-08-23T04:21:45.594 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61210.log: 0.0%/var/log/ceph/ceph-client.admin.66997.log: -- replaced with /var/log/ceph/ceph-client.admin.61210.log.gz 2023-08-23T04:21:45.594 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66997.log.gz 2023-08-23T04:21:45.595 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39832.log 2023-08-23T04:21:45.595 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44001.log 2023-08-23T04:21:45.595 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38228.log.gz 2023-08-23T04:21:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78874.log 2023-08-23T04:21:45.596 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39832.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39832.log.gz 2023-08-23T04:21:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44001.log.gz 2023-08-23T04:21:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37604.log 2023-08-23T04:21:45.597 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42947.log 2023-08-23T04:21:45.598 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78874.log.gz 2023-08-23T04:21:45.598 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43117.log 2023-08-23T04:21:45.599 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37604.log.gz 2023-08-23T04:21:45.599 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35284.log 2023-08-23T04:21:45.600 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42947.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42947.log.gz-5 2023-08-23T04:21:45.600 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.78955.log 2023-08-23T04:21:45.600 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37108.log 2023-08-23T04:21:45.600 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43117.log.gz 2023-08-23T04:21:45.600 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35284.log.gz 2023-08-23T04:21:45.601 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47667.log 2023-08-23T04:21:45.601 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78955.log.gz 2023-08-23T04:21:45.601 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37108.log: /var/log/ceph/ceph-client.admin.39543.log 2023-08-23T04:21:45.601 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37108.log.gz 2023-08-23T04:21:45.601 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59649.log 2023-08-23T04:21:45.602 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47667.log.gz 2023-08-23T04:21:45.602 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52581.log 2023-08-23T04:21:45.602 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39543.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44154.log 2023-08-23T04:21:45.603 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39543.log.gz 2023-08-23T04:21:45.603 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38761.log 2023-08-23T04:21:45.603 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59649.log.gz 2023-08-23T04:21:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52581.log.gz 2023-08-23T04:21:45.604 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50909.log 2023-08-23T04:21:45.605 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44154.log.gz 2023-08-23T04:21:45.605 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71899.log 2023-08-23T04:21:45.605 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57053.log 2023-08-23T04:21:45.605 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38761.log.gz 2023-08-23T04:21:45.606 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50909.log: gzip /var/log/ceph/ceph-client.admin.71899.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.78359.log 2023-08-23T04:21:45.606 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50909.log.gz 2023-08-23T04:21:45.606 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71899.log.gz 2023-08-23T04:21:45.606 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43797.log 2023-08-23T04:21:45.607 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57053.log.gz 2023-08-23T04:21:45.607 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53048.log 2023-08-23T04:21:45.607 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78359.log.gz 2023-08-23T04:21:45.608 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.43797.log: --verbose -- /var/log/ceph/ceph-client.admin.60987.log 2023-08-23T04:21:45.608 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43797.log.gz 2023-08-23T04:21:45.609 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33701.log 2023-08-23T04:21:45.609 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53048.log.gz 2023-08-23T04:21:45.609 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42007.log 2023-08-23T04:21:45.610 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60987.log.gz 2023-08-23T04:21:45.610 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65872.log 2023-08-23T04:21:45.611 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33701.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72650.log 2023-08-23T04:21:45.611 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:21:45.612 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42007.log.gz 2023-08-23T04:21:45.612 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52943.log 2023-08-23T04:21:45.612 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65872.log.gz 2023-08-23T04:21:45.613 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47603.log 2023-08-23T04:21:45.613 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72650.log: 0.0%/var/log/ceph/ceph-client.admin.52943.log: -- replaced with /var/log/ceph/ceph-client.admin.72650.log.gz 2023-08-23T04:21:45.614 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59327.log 2023-08-23T04:21:45.614 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52943.log.gz 2023-08-23T04:21:45.615 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40274.log 2023-08-23T04:21:45.615 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47603.log.gz 2023-08-23T04:21:45.615 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49081.log 2023-08-23T04:21:45.616 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45995.log 2023-08-23T04:21:45.616 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59327.log.gz 2023-08-23T04:21:45.617 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40274.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40274.log.gz 2023-08-23T04:21:45.617 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45365.log 2023-08-23T04:21:45.618 INFO:teuthology.orchestra.run.smithi012.stderr: 57.3% -- replaced with /var/log/ceph/ceph-client.admin.49081.log.gz 2023-08-23T04:21:45.618 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41027.log 2023-08-23T04:21:45.618 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45995.log.gz 2023-08-23T04:21:45.618 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45365.log.gz 2023-08-23T04:21:45.618 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40647.log 2023-08-23T04:21:45.619 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.41027.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52388.log 2023-08-23T04:21:45.619 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41027.log.gz 2023-08-23T04:21:45.619 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74274.log 2023-08-23T04:21:45.619 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40647.log.gz 2023-08-23T04:21:45.620 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76042.log 2023-08-23T04:21:45.620 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52388.log.gz 2023-08-23T04:21:45.620 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.74274.log: --verbose -- /var/log/ceph/ceph-client.admin.71686.log 2023-08-23T04:21:45.621 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74274.log.gz 2023-08-23T04:21:45.621 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69142.log 2023-08-23T04:21:45.621 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76042.log: 0.0%/var/log/ceph/ceph-client.admin.71686.log: -- replaced with /var/log/ceph/ceph-client.admin.76042.log.gz 2023-08-23T04:21:45.621 INFO:teuthology.orchestra.run.smithi012.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.71686.log.gz 2023-08-23T04:21:45.622 INFO:teuthology.orchestra.run.smithi012.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.35370.log 2023-08-23T04:21:45.622 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36313.log 2023-08-23T04:21:45.622 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69142.log.gz 2023-08-23T04:21:45.622 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49633.log 2023-08-23T04:21:45.623 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35370.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35370.log.gz 2023-08-23T04:21:45.623 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35563.log 2023-08-23T04:21:45.623 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36313.log.gz 2023-08-23T04:21:45.623 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61148.log 2023-08-23T04:21:45.623 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49633.log.gz 2023-08-23T04:21:45.624 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63342.log 2023-08-23T04:21:45.624 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35563.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35563.log.gz 2023-08-23T04:21:45.624 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61148.log.gz 2023-08-23T04:21:45.625 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54598.log 2023-08-23T04:21:45.625 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60407.log 2023-08-23T04:21:45.626 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63342.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61029.log 2023-08-23T04:21:45.626 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63342.log.gz/var/log/ceph/ceph-client.admin.54598.log: 2023-08-23T04:21:45.627 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0%/var/log/ceph/ceph-client.admin.60407.log: -- replaced with /var/log/ceph/ceph-client.admin.54598.log.gz 2023-08-23T04:21:45.627 INFO:teuthology.orchestra.run.smithi012.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60407.log.gz-5 2023-08-23T04:21:45.627 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.48982.log 2023-08-23T04:21:45.628 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56435.log 2023-08-23T04:21:45.628 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61029.log: gzip 22.8%-5 -- replaced with /var/log/ceph/ceph-client.admin.61029.log.gz--verbose -- 2023-08-23T04:21:45.629 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56672.log 2023-08-23T04:21:45.629 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48982.log: 53.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66546.log 2023-08-23T04:21:45.629 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56435.log: -- replaced with /var/log/ceph/ceph-client.admin.48982.log.gz 2023-08-23T04:21:45.630 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0%/var/log/ceph/ceph-client.admin.56672.log: -- replaced with /var/log/ceph/ceph-client.admin.56435.log.gz 2023-08-23T04:21:45.630 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56672.log.gz 2023-08-23T04:21:45.630 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68711.log 2023-08-23T04:21:45.631 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64230.log 2023-08-23T04:21:45.631 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66546.log.gz 2023-08-23T04:21:45.632 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44399.log 2023-08-23T04:21:45.632 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68711.log.gz 2023-08-23T04:21:45.632 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36055.log 2023-08-23T04:21:45.633 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64230.log: /var/log/ceph/ceph-client.admin.44399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44399.log.gz 2023-08-23T04:21:45.633 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64230.log.gzgzip 2023-08-23T04:21:45.633 INFO:teuthology.orchestra.run.smithi012.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.53729.log 2023-08-23T04:21:45.633 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68437.log 2023-08-23T04:21:45.634 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36055.log: /var/log/ceph/ceph-client.admin.53729.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60925.log 2023-08-23T04:21:45.634 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36055.log.gz 2023-08-23T04:21:45.634 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53729.log.gz 2023-08-23T04:21:45.634 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51126.log 2023-08-23T04:21:45.635 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52538.log 2023-08-23T04:21:45.635 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68437.log.gz 2023-08-23T04:21:45.635 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60925.log: 0.0%/var/log/ceph/ceph-client.admin.51126.log: -- replaced with /var/log/ceph/ceph-client.admin.60925.log.gz 0.0% 2023-08-23T04:21:45.635 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51126.log.gz 2023-08-23T04:21:45.636 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76385.log 2023-08-23T04:21:45.636 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59498.log 2023-08-23T04:21:45.636 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52538.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52538.log.gz 2023-08-23T04:21:45.636 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34309.log 2023-08-23T04:21:45.637 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76385.log.gz 2023-08-23T04:21:45.637 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.59498.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52083.log 2023-08-23T04:21:45.637 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59498.log.gz 2023-08-23T04:21:45.637 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73737.log 2023-08-23T04:21:45.638 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34309.log: /var/log/ceph/ceph-client.admin.52083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34309.log.gz 2023-08-23T04:21:45.638 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52083.log.gz 2023-08-23T04:21:45.638 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51417.log 2023-08-23T04:21:45.638 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57283.log 2023-08-23T04:21:45.638 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73737.log.gz 2023-08-23T04:21:45.639 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76617.log 2023-08-23T04:21:45.639 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51417.log.gz 2023-08-23T04:21:45.639 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45239.log 2023-08-23T04:21:45.639 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57283.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45008.log 2023-08-23T04:21:45.640 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57283.log.gz 2023-08-23T04:21:45.640 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76617.log: /var/log/ceph/ceph-client.admin.45239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76617.log.gz 2023-08-23T04:21:45.640 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56328.log 2023-08-23T04:21:45.640 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45239.log.gz 2023-08-23T04:21:45.640 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73500.log 2023-08-23T04:21:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45008.log: /var/log/ceph/ceph-client.admin.56328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54272.log 2023-08-23T04:21:45.641 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45008.log.gz 2023-08-23T04:21:45.641 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56328.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39356.log 2023-08-23T04:21:45.641 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:21:45.641 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73500.log.gz 2023-08-23T04:21:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54272.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.54272.log.gz 2023-08-23T04:21:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57862.log 2023-08-23T04:21:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39356.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39356.log.gz 2023-08-23T04:21:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33400.log 2023-08-23T04:21:45.642 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61071.log 2023-08-23T04:21:45.643 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57862.log.gz 2023-08-23T04:21:45.643 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63385.log 2023-08-23T04:21:45.643 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33400.log.gz 2023-08-23T04:21:45.643 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37129.log 2023-08-23T04:21:45.643 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61071.log: gzip /var/log/ceph/ceph-client.admin.63385.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.74640.log 2023-08-23T04:21:45.644 INFO:teuthology.orchestra.run.smithi012.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.61071.log.gz 2023-08-23T04:21:45.644 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63385.log.gz 2023-08-23T04:21:45.644 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52151.log 2023-08-23T04:21:45.644 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37129.log.gz 2023-08-23T04:21:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75741.log 2023-08-23T04:21:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74640.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74640.log.gz 2023-08-23T04:21:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36613.log 2023-08-23T04:21:45.645 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52151.log.gz 2023-08-23T04:21:45.645 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68479.log 2023-08-23T04:21:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75741.log.gz 2023-08-23T04:21:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56457.log 2023-08-23T04:21:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36613.log.gz 2023-08-23T04:21:45.646 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75592.log 2023-08-23T04:21:45.646 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68479.log.gz 2023-08-23T04:21:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42658.log 2023-08-23T04:21:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56457.log.gz 2023-08-23T04:21:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70447.log 2023-08-23T04:21:45.647 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75592.log.gz 2023-08-23T04:21:45.648 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61638.log 2023-08-23T04:21:45.648 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42658.log.gz 2023-08-23T04:21:45.648 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60387.log 2023-08-23T04:21:45.649 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70447.log: 56.5% -- replaced with /var/log/ceph/ceph-client.admin.70447.log.gz 2023-08-23T04:21:45.649 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56629.log 2023-08-23T04:21:45.649 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61638.log.gz 2023-08-23T04:21:45.650 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78793.log 2023-08-23T04:21:45.650 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60387.log.gz 2023-08-23T04:21:45.650 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37065.log 2023-08-23T04:21:45.651 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56629.log.gz 2023-08-23T04:21:45.651 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74145.log 2023-08-23T04:21:45.651 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78793.log.gz 2023-08-23T04:21:45.652 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68347.log 2023-08-23T04:21:45.652 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37065.log.gz 2023-08-23T04:21:45.653 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50747.log 2023-08-23T04:21:45.653 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74145.log.gz 2023-08-23T04:21:45.653 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69678.log 2023-08-23T04:21:45.654 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68347.log.gz 2023-08-23T04:21:45.654 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33529.log 2023-08-23T04:21:45.654 INFO:teuthology.orchestra.run.smithi012.stderr: 22.0% -- replaced with /var/log/ceph/ceph-client.admin.50747.log.gz 2023-08-23T04:21:45.654 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45617.log 2023-08-23T04:21:45.654 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69678.log.gz 2023-08-23T04:21:45.655 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36979.log 2023-08-23T04:21:45.655 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33529.log.gz 2023-08-23T04:21:45.655 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54499.log 2023-08-23T04:21:45.655 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45617.log.gz 2023-08-23T04:21:45.656 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61832.log 2023-08-23T04:21:45.656 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36979.log.gz 2023-08-23T04:21:45.656 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47163.log 2023-08-23T04:21:45.656 INFO:teuthology.orchestra.run.smithi012.stderr: 3.8% -- replaced with /var/log/ceph/ceph-client.admin.54499.log.gz 2023-08-23T04:21:45.657 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69360.log 2023-08-23T04:21:45.657 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61832.log.gz 2023-08-23T04:21:45.657 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68325.log 2023-08-23T04:21:45.658 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47163.log.gz 2023-08-23T04:21:45.658 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70602.log 2023-08-23T04:21:45.658 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69360.log.gz 2023-08-23T04:21:45.658 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.68325.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70171.log 2023-08-23T04:21:45.659 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68325.log.gz 2023-08-23T04:21:45.659 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35047.log 2023-08-23T04:21:45.659 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70602.log.gz 2023-08-23T04:21:45.659 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64795.log 2023-08-23T04:21:45.659 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70171.log.gz 2023-08-23T04:21:45.660 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76940.log 2023-08-23T04:21:45.660 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35047.log.gz 2023-08-23T04:21:45.660 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78820.log 2023-08-23T04:21:45.660 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64795.log.gz 2023-08-23T04:21:45.661 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63069.log 2023-08-23T04:21:45.661 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76940.log.gz 2023-08-23T04:21:45.661 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76554.log 2023-08-23T04:21:45.661 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78820.log.gz 2023-08-23T04:21:45.661 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54073.log 2023-08-23T04:21:45.662 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63069.log.gz 2023-08-23T04:21:45.662 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70389.log 2023-08-23T04:21:45.663 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76554.log: 56.7% -- replaced with /var/log/ceph/ceph-client.admin.76554.log.gz 2023-08-23T04:21:45.663 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73586.log 2023-08-23T04:21:45.663 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54073.log.gz 2023-08-23T04:21:45.663 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60737.log 2023-08-23T04:21:45.664 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70389.log.gz 2023-08-23T04:21:45.664 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57075.log 2023-08-23T04:21:45.664 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73586.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73586.log.gz 2023-08-23T04:21:45.665 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69777.log 2023-08-23T04:21:45.665 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60737.log.gz 2023-08-23T04:21:45.665 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78224.log 2023-08-23T04:21:45.666 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57075.log.gz 2023-08-23T04:21:45.666 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59799.log 2023-08-23T04:21:45.666 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69777.log.gz 2023-08-23T04:21:45.666 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61007.log 2023-08-23T04:21:45.667 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78224.log.gz 2023-08-23T04:21:45.667 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59799.log.gz 2023-08-23T04:21:45.667 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55014.log 2023-08-23T04:21:45.667 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34116.log 2023-08-23T04:21:45.668 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61007.log.gz 2023-08-23T04:21:45.668 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 /var/log/ceph/ceph-client.admin.55014.log: --verbose -- /var/log/ceph/ceph-client.admin.52216.log 2023-08-23T04:21:45.668 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55014.log.gz 2023-08-23T04:21:45.668 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62984.log 2023-08-23T04:21:45.669 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34116.log.gz 2023-08-23T04:21:45.669 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56155.log 2023-08-23T04:21:45.669 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52216.log.gz 2023-08-23T04:21:45.670 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71171.log 2023-08-23T04:21:45.670 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62984.log.gz 2023-08-23T04:21:45.671 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.56155.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.67341.log 2023-08-23T04:21:45.671 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56155.log.gz 2023-08-23T04:21:45.671 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44966.log 2023-08-23T04:21:45.672 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.71171.log: 53.1% -- replaced with /var/log/ceph/ceph-client.admin.71171.log.gz 2023-08-23T04:21:45.672 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67341.log.gz 2023-08-23T04:21:45.672 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38965.log 2023-08-23T04:21:45.673 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45680.log 2023-08-23T04:21:45.673 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44966.log.gz 2023-08-23T04:21:45.674 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62112.log 2023-08-23T04:21:45.674 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.38965.log.gz 2023-08-23T04:21:45.674 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68017.log 2023-08-23T04:21:45.675 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60014.log 2023-08-23T04:21:45.675 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62112.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45680.log.gz 2023-08-23T04:21:45.676 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62112.log.gz 2023-08-23T04:21:45.676 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66153.log 2023-08-23T04:21:45.676 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68017.log.gz 2023-08-23T04:21:45.677 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51046.log 2023-08-23T04:21:45.677 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60014.log.gz 2023-08-23T04:21:45.677 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52995.log 2023-08-23T04:21:45.678 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66153.log.gz 2023-08-23T04:21:45.678 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62306.log 2023-08-23T04:21:45.679 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51046.log.gz 2023-08-23T04:21:45.679 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37948.log 2023-08-23T04:21:45.679 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52995.log.gz 2023-08-23T04:21:45.680 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64816.log 2023-08-23T04:21:45.680 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62306.log.gz 2023-08-23T04:21:45.680 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33830.log 2023-08-23T04:21:45.681 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37948.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37948.log.gz 2023-08-23T04:21:45.681 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66739.log 2023-08-23T04:21:45.682 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64816.log.gz 2023-08-23T04:21:45.682 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42556.log 2023-08-23T04:21:45.682 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33830.log.gz 2023-08-23T04:21:45.682 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66739.log: /var/log/ceph/ceph-client.admin.45596.log 2023-08-23T04:21:45.683 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66739.log.gz 2023-08-23T04:21:45.683 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.42556.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.40257.log 2023-08-23T04:21:45.684 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42556.log.gz 2023-08-23T04:21:45.684 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46439.log 2023-08-23T04:21:45.685 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45596.log.gz 2023-08-23T04:21:45.685 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56199.log /var/log/ceph/ceph-client.admin.40257.log: 2023-08-23T04:21:45.685 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40257.log.gz 2023-08-23T04:21:45.686 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57604.log 2023-08-23T04:21:45.686 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46439.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46439.log.gz 2023-08-23T04:21:45.687 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65310.log 2023-08-23T04:21:45.687 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56199.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56199.log.gz-5 2023-08-23T04:21:45.687 INFO:teuthology.orchestra.run.smithi012.stderr:--verbose -- /var/log/ceph/ceph-client.admin.56844.log 2023-08-23T04:21:45.688 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57604.log.gz 2023-08-23T04:21:45.688 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51503.log 2023-08-23T04:21:45.689 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65310.log.gz 2023-08-23T04:21:45.689 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65182.log 2023-08-23T04:21:45.689 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56844.log.gz 2023-08-23T04:21:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51503.log: /var/log/ceph/ceph-client.admin.37890.log 2023-08-23T04:21:45.690 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51503.log.gz 2023-08-23T04:21:45.690 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72392.log 2023-08-23T04:21:45.691 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65182.log.gz 2023-08-23T04:21:45.691 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62671.log 2023-08-23T04:21:45.691 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37890.log.gz 2023-08-23T04:21:45.691 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.72392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72392.log.gz 2023-08-23T04:21:45.691 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57626.log 2023-08-23T04:21:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62671.log.gz 2023-08-23T04:21:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64152.log 2023-08-23T04:21:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40887.log 2023-08-23T04:21:45.692 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57626.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57626.log.gz 2023-08-23T04:21:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79283.log 2023-08-23T04:21:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64152.log.gz 2023-08-23T04:21:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34054.log 2023-08-23T04:21:45.693 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40887.log.gz 2023-08-23T04:21:45.693 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69420.log 2023-08-23T04:21:45.694 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79283.log.gz 2023-08-23T04:21:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74253.log 2023-08-23T04:21:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34054.log.gz 2023-08-23T04:21:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70779.log 2023-08-23T04:21:45.694 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69420.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69420.log.gz 2023-08-23T04:21:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46353.log 2023-08-23T04:21:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74253.log.gz 2023-08-23T04:21:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34961.log 2023-08-23T04:21:45.695 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32776.log 2023-08-23T04:21:45.695 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70779.log.gz 2023-08-23T04:21:45.696 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46353.log.gz 2023-08-23T04:21:45.696 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55385.log 2023-08-23T04:21:45.696 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34961.log.gz 2023-08-23T04:21:45.696 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45029.log 2023-08-23T04:21:45.696 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32776.log.gz 2023-08-23T04:21:45.697 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46676.log 2023-08-23T04:21:45.697 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55385.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55385.log.gz 2023-08-23T04:21:45.697 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78928.log 2023-08-23T04:21:45.697 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45029.log.gz 2023-08-23T04:21:45.697 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55324.log 2023-08-23T04:21:45.698 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46676.log.gz 2023-08-23T04:21:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61896.log 2023-08-23T04:21:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78928.log.gz 2023-08-23T04:21:45.698 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39101.log 2023-08-23T04:21:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32587.log 2023-08-23T04:21:45.699 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55324.log.gz 2023-08-23T04:21:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61896.log.gz 2023-08-23T04:21:45.699 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57011.log 2023-08-23T04:21:45.699 INFO:teuthology.orchestra.run.smithi012.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.39101.log.gz 2023-08-23T04:21:45.700 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43423.log 2023-08-23T04:21:45.700 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32587.log.gz 2023-08-23T04:21:45.700 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59348.log 2023-08-23T04:21:45.700 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79773.log 2023-08-23T04:21:45.701 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57011.log.gz 2023-08-23T04:21:45.701 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43423.log.gz 2023-08-23T04:21:45.701 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.59348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34441.log 2023-08-23T04:21:45.701 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59348.log.gz 2023-08-23T04:21:45.701 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43270.log 2023-08-23T04:21:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79773.log.gz 2023-08-23T04:21:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48600.log 2023-08-23T04:21:45.702 INFO:teuthology.orchestra.run.smithi012.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.34441.log.gz 2023-08-23T04:21:45.702 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45785.log 2023-08-23T04:21:45.702 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43270.log.gz 2023-08-23T04:21:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32668.log 2023-08-23T04:21:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48600.log: 23.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73479.log 2023-08-23T04:21:45.703 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45785.log: -- replaced with /var/log/ceph/ceph-client.admin.48600.log.gz 2023-08-23T04:21:45.703 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45785.log.gz 2023-08-23T04:21:45.704 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49510.log 2023-08-23T04:21:45.704 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.32668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32668.log.gz 2023-08-23T04:21:45.704 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39050.log 2023-08-23T04:21:45.704 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74210.log 2023-08-23T04:21:45.704 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73479.log.gz 2023-08-23T04:21:45.705 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49510.log.gz 2023-08-23T04:21:45.705 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49987.log 2023-08-23T04:21:45.705 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39050.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39050.log.gz 2023-08-23T04:21:45.705 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69303.log 2023-08-23T04:21:45.705 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63046.log 2023-08-23T04:21:45.706 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74210.log.gz 2023-08-23T04:21:45.706 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.49987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50408.log 2023-08-23T04:21:45.706 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49987.log.gz 2023-08-23T04:21:45.706 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69303.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62370.log 2023-08-23T04:21:45.706 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69303.log.gz 2023-08-23T04:21:45.707 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.63046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63046.log.gz 2023-08-23T04:21:45.707 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42407.log 2023-08-23T04:21:45.707 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50408.log.gz 2023-08-23T04:21:45.707 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75956.log 2023-08-23T04:21:45.707 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62370.log: 0.0%/var/log/ceph/ceph-client.admin.42407.log: -- replaced with /var/log/ceph/ceph-client.admin.62370.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75344.log 2023-08-23T04:21:45.708 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:21:45.708 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42407.log.gz 2023-08-23T04:21:45.708 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75222.log 2023-08-23T04:21:45.708 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75956.log.gz 2023-08-23T04:21:45.708 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46869.log 2023-08-23T04:21:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75344.log.gz 2023-08-23T04:21:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78549.log 2023-08-23T04:21:45.709 INFO:teuthology.orchestra.run.smithi012.stderr: 10.2% -- replaced with /var/log/ceph/ceph-client.admin.75222.log.gz 2023-08-23T04:21:45.709 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64511.log 2023-08-23T04:21:45.710 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46869.log.gz 2023-08-23T04:21:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44207.log 2023-08-23T04:21:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78549.log.gz 2023-08-23T04:21:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42811.log 2023-08-23T04:21:45.710 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64511.log.gz 2023-08-23T04:21:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40393.log 2023-08-23T04:21:45.711 INFO:teuthology.orchestra.run.smithi012.stderr: 54.7% -- replaced with /var/log/ceph/ceph-client.admin.44207.log.gz 2023-08-23T04:21:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33120.log 2023-08-23T04:21:45.711 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42811.log: 0.0%/var/log/ceph/ceph-client.admin.40393.log: -- replaced with /var/log/ceph/ceph-client.admin.42811.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61231.log 2023-08-23T04:21:45.711 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:21:45.712 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.40393.log.gz 2023-08-23T04:21:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53137.log 2023-08-23T04:21:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33120.log.gz 2023-08-23T04:21:45.712 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.61231.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.61231.log.gz/var/log/ceph/ceph-client.admin.74769.log 2023-08-23T04:21:45.712 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:21:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67922.log 2023-08-23T04:21:45.713 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53137.log.gz 2023-08-23T04:21:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73930.log 2023-08-23T04:21:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74769.log.gz 2023-08-23T04:21:45.713 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38400.log 2023-08-23T04:21:45.714 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67922.log.gz 2023-08-23T04:21:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.73930.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.74618.log 2023-08-23T04:21:45.714 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73930.log.gz 2023-08-23T04:21:45.714 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48435.log 2023-08-23T04:21:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38400.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38400.log.gz 2023-08-23T04:21:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74618.log.gz 2023-08-23T04:21:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36957.log 2023-08-23T04:21:45.715 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36484.log 2023-08-23T04:21:45.715 INFO:teuthology.orchestra.run.smithi012.stderr: 18.5% -- replaced with /var/log/ceph/ceph-client.admin.48435.log.gz 2023-08-23T04:21:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70353.log 2023-08-23T04:21:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36957.log.gz 2023-08-23T04:21:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39798.log 2023-08-23T04:21:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.36484.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75698.log 2023-08-23T04:21:45.716 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70353.log: 24.1% -- replaced with /var/log/ceph/ceph-client.admin.36484.log.gz 2023-08-23T04:21:45.717 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70353.log.gz 2023-08-23T04:21:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39798.log: gzip -5 --verbose -- 1.2%/var/log/ceph/ceph-client.admin.48942.log 2023-08-23T04:21:45.717 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39798.log.gz 2023-08-23T04:21:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33292.log 2023-08-23T04:21:45.717 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75698.log.gz 2023-08-23T04:21:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69101.log 2023-08-23T04:21:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48942.log: 22.8%/var/log/ceph/ceph-client.admin.33292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79557.log 2023-08-23T04:21:45.718 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.48942.log.gz 2023-08-23T04:21:45.718 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33292.log.gz 2023-08-23T04:21:45.718 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41167.log /var/log/ceph/ceph-client.admin.69101.log: 2023-08-23T04:21:45.719 INFO:teuthology.orchestra.run.smithi012.stderr: 56.5% -- replaced with /var/log/ceph/ceph-client.admin.69101.log.gz 2023-08-23T04:21:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.79557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64212.log 2023-08-23T04:21:45.719 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.79557.log.gz 2023-08-23T04:21:45.719 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34403.log 2023-08-23T04:21:45.720 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41167.log.gz 2023-08-23T04:21:45.720 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51718.log 2023-08-23T04:21:45.720 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.64212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64212.log.gz 2023-08-23T04:21:45.720 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.34403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62091.log 2023-08-23T04:21:45.720 INFO:teuthology.orchestra.run.smithi012.stderr: 2.5% -- replaced with /var/log/ceph/ceph-client.admin.34403.log.gz 2023-08-23T04:21:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56090.log 2023-08-23T04:21:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.51718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51718.log.gz 2023-08-23T04:21:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50049.log 2023-08-23T04:21:45.721 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62091.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73037.log 2023-08-23T04:21:45.721 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62091.log.gz 2023-08-23T04:21:45.722 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.56090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56090.log.gz 2023-08-23T04:21:45.722 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52409.log 2023-08-23T04:21:45.722 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50049.log.gz 2023-08-23T04:21:45.722 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42913.log 2023-08-23T04:21:45.722 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73037.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73037.log.gz 2023-08-23T04:21:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78170.log 2023-08-23T04:21:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52409.log: gzip -5 --verbose 0.0%-- -- replaced with /var/log/ceph/ceph-client.admin.52409.log.gz/var/log/ceph/ceph-client.admin.37172.log 2023-08-23T04:21:45.723 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:21:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.42913.log: 0.0%/var/log/ceph/ceph-client.admin.78170.log: -- replaced with /var/log/ceph/ceph-client.admin.42913.log.gz 2023-08-23T04:21:45.723 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72874.log 2023-08-23T04:21:45.724 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78170.log.gz 2023-08-23T04:21:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68657.log 2023-08-23T04:21:45.724 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37172.log: /var/log/ceph/ceph-client.admin.72874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35542.log 2023-08-23T04:21:45.724 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37172.log.gz 2023-08-23T04:21:45.724 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72874.log.gz 2023-08-23T04:21:45.725 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41947.log 2023-08-23T04:21:45.725 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.68657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68657.log.gz 2023-08-23T04:21:45.725 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33228.log 2023-08-23T04:21:45.725 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35542.log.gz 2023-08-23T04:21:45.725 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43338.log /var/log/ceph/ceph-client.admin.41947.log: 2023-08-23T04:21:45.726 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41947.log.gz 2023-08-23T04:21:45.726 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75655.log 2023-08-23T04:21:45.726 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33228.log.gz 2023-08-23T04:21:45.726 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.43338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43338.log.gz 2023-08-23T04:21:45.726 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50428.log 2023-08-23T04:21:45.727 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.75655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.75655.log.gz 2023-08-23T04:21:45.727 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33249.log 2023-08-23T04:21:45.727 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.50428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47041.log 2023-08-23T04:21:45.727 INFO:teuthology.orchestra.run.smithi012.stderr: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.50428.log.gz 2023-08-23T04:21:45.727 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47560.log 2023-08-23T04:21:45.728 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33249.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33249.log.gz 2023-08-23T04:21:45.728 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60100.log 2023-08-23T04:21:45.728 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47041.log.gz 2023-08-23T04:21:45.728 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.47560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78008.log 2023-08-23T04:21:45.729 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47560.log.gz 2023-08-23T04:21:45.729 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41627.log 2023-08-23T04:21:45.729 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60100.log.gz 2023-08-23T04:21:45.729 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.78008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55554.log 2023-08-23T04:21:45.729 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.78008.log.gz 2023-08-23T04:21:45.730 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45932.log 2023-08-23T04:21:45.730 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.41627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41627.log.gz 2023-08-23T04:21:45.730 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44840.log 2023-08-23T04:21:45.730 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55554.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55554.log.gz 2023-08-23T04:21:45.730 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.45932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39203.log 2023-08-23T04:21:45.731 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45932.log.gz 2023-08-23T04:21:45.731 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54758.log 2023-08-23T04:21:45.731 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.44840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.44840.log.gz 2023-08-23T04:21:45.731 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39203.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39203.log.gz 2023-08-23T04:21:45.732 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66675.log 2023-08-23T04:21:45.732 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52861.log 2023-08-23T04:21:45.732 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54758.log.gz 2023-08-23T04:21:45.733 INFO:teuthology.orchestra.run.smithi012.stderr:gzip /var/log/ceph/ceph-client.admin.66675.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.67384.log 2023-08-23T04:21:45.733 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66675.log.gz 2023-08-23T04:21:45.734 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67879.log 2023-08-23T04:21:45.734 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52861.log.gz 2023-08-23T04:21:45.734 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60079.log 2023-08-23T04:21:45.735 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67384.log.gz 2023-08-23T04:21:45.735 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.67879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38314.log 2023-08-23T04:21:45.735 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67879.log.gz 2023-08-23T04:21:45.736 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70941.log 2023-08-23T04:21:45.736 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60079.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60079.log.gz 2023-08-23T04:21:45.737 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60551.log 2023-08-23T04:21:45.737 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38314.log.gz 2023-08-23T04:21:45.738 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.70941.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40463.log 2023-08-23T04:21:45.738 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.70941.log.gz 2023-08-23T04:21:45.739 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52104.log 2023-08-23T04:21:45.739 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.60551.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60551.log.gz 2023-08-23T04:21:45.739 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-08-23T04:21:45.740 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62241.log 2023-08-23T04:21:45.740 INFO:teuthology.orchestra.run.smithi012.stderr: 56.7% -- replaced with /var/log/ceph/ceph-client.admin.40463.log.gz 2023-08-23T04:21:45.741 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.52104.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52104.log.gz 2023-08-23T04:21:45.741 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57905.log 2023-08-23T04:21:45.741 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40667.log 2023-08-23T04:21:45.742 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.62241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62241.log.gz 2023-08-23T04:21:45.742 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.57905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53276.log 2023-08-23T04:21:45.742 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57905.log.gz 2023-08-23T04:21:45.742 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.40667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40667.log.gz 2023-08-23T04:21:45.743 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73371.log 2023-08-23T04:21:45.743 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53276.log.gz 2023-08-23T04:21:45.743 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74911.log 2023-08-23T04:21:45.743 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65362.log 2023-08-23T04:21:45.743 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.73371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.73371.log.gz 2023-08-23T04:21:45.744 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.74911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35176.log 2023-08-23T04:21:45.744 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.74911.log.gz 2023-08-23T04:21:45.744 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37796.log 2023-08-23T04:21:45.744 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65362.log.gz 2023-08-23T04:21:45.745 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.35176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35176.log.gz 2023-08-23T04:21:45.745 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66976.log 2023-08-23T04:21:45.745 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37796.log: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.37796.log.gz 2023-08-23T04:21:45.745 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37625.log 2023-08-23T04:21:45.745 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33335.log 2023-08-23T04:21:45.746 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.66976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66976.log.gz 2023-08-23T04:21:45.746 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.37625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33443.log 2023-08-23T04:21:45.746 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37625.log.gz 2023-08-23T04:21:45.747 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38013.log 2023-08-23T04:21:45.747 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33335.log.gz 2023-08-23T04:21:45.747 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.33443.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33443.log.gz 2023-08-23T04:21:45.748 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72977.log 2023-08-23T04:21:45.748 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48455.log 2023-08-23T04:21:45.749 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.38013.log: 0.0%/var/log/ceph/ceph-client.admin.72977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65661.log 2023-08-23T04:21:45.749 INFO:teuthology.orchestra.run.smithi012.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38013.log.gz 2023-08-23T04:21:45.749 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.72977.log.gz 2023-08-23T04:21:45.750 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.48455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55983.log 2023-08-23T04:21:45.750 INFO:teuthology.orchestra.run.smithi012.stderr: 55.9% -- replaced with /var/log/ceph/ceph-client.admin.48455.log.gz 2023-08-23T04:21:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46016.log 2023-08-23T04:21:45.751 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65289.log 2023-08-23T04:21:45.751 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65661.log.gz 2023-08-23T04:21:45.752 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.55983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55983.log.gz 2023-08-23T04:21:45.752 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.46016.log: 22.4% -- replaced with /var/log/ceph/ceph-client.admin.46016.log.gz 2023-08-23T04:21:45.753 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76171.log 2023-08-23T04:21:45.753 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65289.log.gz 2023-08-23T04:21:45.753 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39696.log 2023-08-23T04:21:45.754 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.76171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.76171.log.gz 2023-08-23T04:21:45.754 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69380.log 2023-08-23T04:21:45.755 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65441.log 2023-08-23T04:21:45.755 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39696.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39696.log.gz 2023-08-23T04:21:45.755 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.69380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53966.log 2023-08-23T04:21:45.756 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69380.log.gz 2023-08-23T04:21:45.756 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.65441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54334.log 2023-08-23T04:21:45.757 INFO:teuthology.orchestra.run.smithi012.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65441.log.gz 2023-08-23T04:21:45.757 INFO:teuthology.orchestra.run.smithi012.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39237.log 2023-08-23T04:21:45.757 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.53966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53966.log.gz 2023-08-23T04:21:45.758 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.54334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54334.log.gz 2023-08-23T04:21:45.758 INFO:teuthology.orchestra.run.smithi012.stderr:/var/log/ceph/ceph-client.admin.39237.log: 1.2% -- replaced with /var/log/ceph/ceph-client.admin.39237.log.gz 2023-08-23T04:21:45.759 INFO:teuthology.orchestra.run.smithi012.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-08-23T04:21:47.771 INFO:teuthology.orchestra.run.smithi012.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-08-23T04:21:48.598 INFO:teuthology.orchestra.run.smithi012.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-08-23T04:22:10.547 INFO:teuthology.orchestra.run.smithi012.stderr: 96.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-08-23T04:22:21.006 INFO:teuthology.orchestra.run.smithi012.stderr: 96.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-08-23T04:22:21.008 INFO:teuthology.orchestra.run.smithi012.stderr: 2023-08-23T04:22:21.008 INFO:teuthology.orchestra.run.smithi012.stderr:real 0m36.789s 2023-08-23T04:22:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:user 1m9.354s 2023-08-23T04:22:21.009 INFO:teuthology.orchestra.run.smithi012.stderr:sys 0m2.999s 2023-08-23T04:22:21.010 INFO:tasks.ceph:Archiving logs... 2023-08-23T04:22:21.011 DEBUG:teuthology.misc:Transferring archived files from smithi012:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-08-22_18:59:01-rbd-pacific-release-distro-default-smithi/7376986/remote/smithi012/log 2023-08-23T04:22:21.013 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-23T04:22:28.834 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa/tasks/ceph.py", line 1914, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa/tasks/ceph.py", line 1309, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-08-23T04:22:28.835 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-23T04:22:28.856 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa/tasks/ceph.py", line 1914, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa/tasks/ceph.py", line 1309, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-08-23T04:22:28.858 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-23T04:22:28.859 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-23T04:22:28.904 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-23T04:22:28.919 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-23T04:22:28.919 DEBUG:teuthology.orchestra.run.smithi012:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-23T04:22:28.944 INFO:teuthology.orchestra.run.smithi012.stdout: remote refid st t when poll reach delay offset jitter 2023-08-23T04:22:28.945 INFO:teuthology.orchestra.run.smithi012.stdout:============================================================================== 2023-08-23T04:22:28.945 INFO:teuthology.orchestra.run.smithi012.stdout:*hv01.front.sepi 44.4.53.2 2 u 144 256 377 0.167 -0.117 0.163 2023-08-23T04:22:28.945 INFO:teuthology.orchestra.run.smithi012.stdout:+hv02.front.sepi 63.231.80.2 3 u 67 256 377 0.196 3.274 0.100 2023-08-23T04:22:28.946 INFO:teuthology.orchestra.run.smithi012.stdout:+hv03.front.sepi 74.6.168.72 3 u 122 256 377 0.194 -0.212 0.417 2023-08-23T04:22:28.946 INFO:teuthology.orchestra.run.smithi012.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 0.000 0.000 2023-08-23T04:22:28.947 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-23T04:22:28.956 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-23T04:22:28.956 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-23T04:22:28.965 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-23T04:22:28.973 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-23T04:22:28.988 INFO:teuthology.task.internal:Duration was 12801.051160 seconds 2023-08-23T04:22:28.989 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-23T04:22:28.998 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-23T04:22:28.998 DEBUG:teuthology.orchestra.run.smithi012:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-23T04:22:29.048 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-23T04:22:29.049 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi012.front.sepia.ceph.com 2023-08-23T04:22:29.050 DEBUG:teuthology.orchestra.run.smithi012:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-23T04:22:29.061 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-23T04:22:29.062 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-23T04:22:29.089 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-23T04:22:29.090 DEBUG:teuthology.orchestra.run.smithi012:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-23T04:22:29.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-23T04:22:29.210 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-23T04:22:29.211 DEBUG:teuthology.orchestra.run.smithi012:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-23T04:22:29.226 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-23T04:22:29.244 DEBUG:teuthology.orchestra.run.smithi012:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-23T04:22:29.281 INFO:teuthology.orchestra.run.smithi012.stdout:kernel.core_pattern = core 2023-08-23T04:22:29.305 DEBUG:teuthology.orchestra.run.smithi012:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-23T04:22:29.311 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-23T04:22:29.312 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-23T04:22:29.322 INFO:teuthology.task.internal:Transferring archived files... 2023-08-23T04:22:29.323 DEBUG:teuthology.misc:Transferring archived files from smithi012:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-08-22_18:59:01-rbd-pacific-release-distro-default-smithi/7376986/remote/smithi012 2023-08-23T04:22:29.324 DEBUG:teuthology.orchestra.run.smithi012:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-23T04:22:29.346 INFO:teuthology.task.internal:Removing archive directory... 2023-08-23T04:22:29.347 DEBUG:teuthology.orchestra.run.smithi012:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-23T04:22:29.392 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-23T04:22:29.403 INFO:teuthology.task.internal:Not uploading archives. 2023-08-23T04:22:29.403 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-23T04:22:29.414 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-23T04:22:29.414 DEBUG:teuthology.orchestra.run.smithi012:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-23T04:22:29.422 INFO:teuthology.orchestra.run.smithi012.stdout: 924112 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Aug 23 04:22 /home/ubuntu/cephtest 2023-08-23T04:22:29.423 INFO:teuthology.orchestra.run.smithi012.stdout: 1064753 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Aug 23 00:58 /home/ubuntu/cephtest/mnt.0 2023-08-23T04:22:29.423 INFO:teuthology.orchestra.run.smithi012.stdout: 1064754 4 drwxrwxr-x 3 ubuntu ubuntu 4096 Aug 23 00:58 /home/ubuntu/cephtest/mnt.0/client.0 2023-08-23T04:22:29.423 INFO:teuthology.orchestra.run.smithi012.stdout: 1194271 4 drwxrwxr-x 2 ubuntu ubuntu 4096 Aug 23 00:58 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-08-23T04:22:29.424 INFO:teuthology.orchestra.run.smithi012.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2023-08-23T04:22:29.424 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-23T04:22:29.425 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa/tasks/ceph.py", line 1914, in task osd_scrub_pgs(ctx, config) File "/home/teuthworker/src/github.com_ceph_ceph-c_21b2d401852937440c3da8ce2b19224181760caa/qa/tasks/ceph.py", line 1309, in osd_scrub_pgs raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') RuntimeError: Exiting scrub checking -- not all pgs scrubbed. During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_449a1bc2027504e7b3c3d7b30fa4178906581da7/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi012 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2023-08-23T04:22:29.438 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-23T04:22:29.451 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-23T04:22:29.469 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: Exiting scrub checking -- not all pgs scrubbed. 2023-08-23T04:22:29.470 INFO:teuthology.nuke:Checking targets against current locks 2023-08-23T04:22:29.501 DEBUG:teuthology.nuke:shortname: smithi012 2023-08-23T04:22:29.501 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-23T04:22:29.524 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi012.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-08-22_18:59:01-rbd-pacific-release-distro-default-smithi/7376986', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-23 00:40:02.001119', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwINnmi+N3LgR9ET61cABYBnDJDAAQE1klaPINljTOvitiIM3/5ICam+qurn41RkfyLPz4uwE1yDyHeI7QBKChMImagaJPfltOSsFsTn67ifp6uunrBJblDzycEd7/lJfdMwBn8dApfOw5SSnVdpzpaKWGNpPqshrinViULNhTz2PMAkza/R7qM6v4qqKKxQx/yVi8/Lt03nxO672k5WH/Wkz7KHX4nwyeTelksSojH9SBt4yR4WpLbMjuFX33Ag14KBWr9YQ30L5/h7VtBLQL+2c7sq3Bnll5zj8H+sIa0hOHmwR5sxs4cVs6Eb4Cblr6xTs0Q9vQefWDDYNL4qRpuj1NO+bW1xGcALK9TujCJ0/fdcMLQ0/r4QukVxSE1j6frwWwo/u8lxTTp/wbNVU14w+37ppSvzcPbOD5FNnCu4PMHgrtqp02ggncjqMYpHvxXoQ53JPn84XfXX04vWf5emRMQ76T0NvWW0jYtj7x7ex7l/iEGUGHVnaOmjLqij0='} 2023-08-23T04:22:29.580 INFO:teuthology.orchestra.console.smithi012:Power off 2023-08-23T04:22:29.582 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-23T04:22:29.607 DEBUG:teuthology.orchestra.console.smithi012:power off output: Chassis Power Control: Down/Off 2023-08-23T04:22:29.608 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T04:22:29.632 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-08-23T04:22:33.635 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T04:22:33.747 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is on 2023-08-23T04:22:37.751 DEBUG:teuthology.orchestra.console.smithi012:pexpect command: ipmitool -H smithi012.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-23T04:22:37.864 DEBUG:teuthology.orchestra.console.smithi012:check power output: Chassis Power is off 2023-08-23T04:22:37.965 INFO:teuthology.orchestra.console.smithi012:Power off completed 2023-08-23T04:22:38.077 INFO:teuthology.run:Summary data: description: rbd/cli_v1/{base/install clusters/{fixed-1 openstack} features/format-1 msgr-failures/few objectstore/bluestore-stupid pool/small-cache-pool supported-random-distro$/{ubuntu_latest} workloads/rbd_cli_generic} duration: 12801.051159858704 failure_reason: 'Command failed (workunit test rbd/cli_generic.sh) on smithi012 with status 124: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=21b2d401852937440c3da8ce2b19224181760caa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/cli_generic.sh''' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=b6a61815f2494344a19189a70029b0be status: fail success: false 2023-08-23T04:22:38.078 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-23T04:22:38.146 INFO:teuthology.run:FAIL